Control device, control method, and program

ABSTRACT

There is provided a control device, a control method, and a program through which it is possible to implement a more suitable imaging environment even under a situation in which auxiliary light is emitted from a plurality of light sources, the control device including: an acquisition unit configured to acquire a light emission state of a first light source; and a control unit configured to control an operation of light emission of a second light source that is different from the first light source according to the acquired light emission state of the first light source.

CROSS REFERENCE TO PRIOR APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/052,032 (filed on Aug. 1, 2018), which is a continuation of U.S.patent application Ser. No. 15/324,852 (filed on Jan. 9, 2017 and issuedas U.S. Pat. No. 10,057,961 on Aug. 21, 2018), which is a National StagePatent Application of PCT International Patent Application No.PCT/JP2015/067418 (filed on Jun. 17, 2015) under 35 U.S.C. § 371, whichclaims priority to Japanese Patent Application No. 2014-174678 (filed onAug. 29, 2014), which are all hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to a control device, a control method,and a program.

BACKGROUND ART

When an image is captured by an imaging device such as a digital stillcamera and a digital video camera under illumination of low illuminance,in order to implement a more suitable imaging environment, auxiliarylight is emitted toward a subject from a light source that is operatedin linkage with the imaging device in some cases. In this manner, byemitting auxiliary light toward the subject, the imaging device canrecognize the subject in the captured image, for example, even underillumination of low illuminance and can control a focal positionaccording to an autofocus (AF) function and detect the subject accordingto a facial recognition technology and the like. For example, PatentLiterature 1 discloses an example of a configuration in which auxiliarylight is emitted toward a subject when an image is captured by animaging device.

CITATION LIST Patent Literature

Patent Literature 1 JP 2006-180271A

DISCLOSURE OF INVENTION Technical Problem

Meanwhile, as in a case in which an imaging device is used as amonitoring camera, a plurality of imaging devices are operated inlinkage in some cases. In such a case, auxiliary light is emitted from aplurality of light sources in linkage with the imaging devices, andauxiliary light of a light source that is operated in linkage withanother imaging device is emitted toward a subject of a certain imagingdevice in some cases. Therefore, it is necessary to provide a mechanismthrough which it is possible to implement a more suitable imagingenvironment even under an environment in which auxiliary light isemitted from a plurality of light sources.

Accordingly, the present disclosure proposes a control device, a controlmethod, and a program through which it is possible to implement a moresuitable imaging environment even under a situation in which auxiliarylight is emitted from a plurality of light sources.

Solution to Problem

According to the present disclosure, there is provided a control deviceincluding: an acquisition unit configured to acquire a light emissionstate of a first light source; and a control unit configured to controlan operation of light emission of a second light source that isdifferent from the first light source according to the acquired lightemission state of the first light source.

According to the present disclosure, there is provided a control methodperformed by a processor, the control method including: acquiring alight emission state of a first light source; and controlling anoperation of light emission of a second light source that is differentfrom the first light source according to the acquired light emissionstate of the first light source.

According to the present disclosure, there is provided a program causinga computer to execute: acquiring a light emission state of a first lightsource; and controlling an operation of light emission of a second lightsource that is different from the first light source according to theacquired light emission state of the first light source.

Advantageous Effects of Invention

According to the present disclosure described above, there are provideda control device, a control method, and a program through which it ispossible to implement a more suitable imaging environment even under asituation in which auxiliary light is emitted from a plurality of lightsources.

Note that the effects described above are not necessarily limitative.With or in the place of the above effects, there may be achieved any oneof the effects described in this specification or other effects that maybe grasped from this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an explanatory diagram for describing an example of aschematic system configuration of a control system according to a firstembodiment of the present disclosure.

FIG. 2 is an explanatory diagram for describing an overview of thecontrol system according to the embodiment.

FIG. 3 is an explanatory diagram for describing schematic operations ofthe control system according to the embodiment.

FIG. 4 is a block diagram showing an example of a functionalconfiguration of the control system according to the embodiment.

FIG. 5 is a flowchart showing an example of a flow of a series ofprocesses of the control system according to the embodiment.

FIG. 6 is an explanatory diagram for describing an overview of a controlsystem according to Modified Example 1.

FIG. 7 is an explanatory diagram for describing an overview of a controlsystem 1 according to Modified Example 1.

FIG. 8 is a block diagram showing an example of a configuration of acontrol system according to Modified Example 2.

FIG. 9 is a block diagram showing an example of a functionalconfiguration of a control system according to Modified Example 3.

FIG. 10 is a block diagram showing an example of a functionalconfiguration of a control system according to Modified Example 4.

FIG. 11 is an explanatory diagram for describing schematic operations ofa control system according to a second embodiment of the presentdisclosure.

FIG. 12 is a block diagram showing an example of a functionalconfiguration of the control system according to the embodiment.

FIG. 13 is a flowchart showing an example of a flow of a series ofprocesses of the control system according to the embodiment.

FIG. 14 is a diagram showing an example of a hardware configuration ofan imaging device according to the embodiment.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. In thisspecification and the appended drawings, structural elements that havesubstantially the same function and structure are denoted with the samereference numerals, and repeated explanation of these structuralelements is omitted.

Description will proceed in the following order.

-   1. First Embodiment    -   1.1. Overview    -   1.2. Functional configuration    -   1.3. Processes    -   1.4. Modified Examples        -   1.4.1. Modified Example 1: Control when three or more            imaging devices are operated        -   1.4.2. Modified Example 2: Example of system configuration        -   1.4.3. Modified Example 3: Example of functional            configuration        -   1.4.4. Modified Example 4: Example of functional            configuration    -   1.5. Summary-   2. Second Embodiment    -   2.1. Overview    -   2.2. Functional configuration    -   2.3. Processes-   3. Hardware configuration-   4. Summary

1. First Embodiment 1.1. Overview

First, an example of a schematic system configuration of a controlsystem 1 according to a first embodiment of the present disclosure willbe described with reference to FIG. 1. FIG. 1 is an explanatory diagramfor describing an example of a schematic system configuration of thecontrol system 1 according to the embodiment. The control system 1according to the embodiment includes a plurality of imaging devices. Forexample, in the example shown in FIG. 1, the control system 1 includesimaging devices 10 a and 10 b. Also, in the example shown in FIG. 1.

The imaging device 10 a includes an imaging unit 15 a and an auxiliarylight emitting unit 13 a. The imaging unit 15 a is a component forcapturing an image of a subject and includes an imaging element 16 asuch as a complementary metal-oxide semiconductor (CMOS) image sensorand a charge coupled device (CCD) image sensor and an optical systemsuch as a lens.

In addition, the auxiliary light emitting unit 13 a is a component foremitting auxiliary light toward a subject and includes a light sourceconfigured to emit the auxiliary light. Also, a kind of auxiliary lightemitted toward a subject from the auxiliary light emitting unit 13 a isnot particularly limited. As a specific example, the auxiliary lightemitting unit 13 a may be configured to emit so-called visible light asauxiliary light. In addition, as another example, the auxiliary lightemitting unit 13 a may be configured to emit invisible light such asinfrared (IR) light as auxiliary light.

Note that, while the example in which the imaging device 10 a includesthe auxiliary light emitting unit 13 a has been described in FIG. 1, theauxiliary light emitting unit 13 a may be provided outside the imagingdevice 10 a as long as the auxiliary light emitting unit 13 a can beoperated based on control of the imaging device 10 a. As a specificexample, the auxiliary light emitting unit 13 a may be configured as aso-called externally attached auxiliary light emitter.

Similarly, the imaging device 10 b includes an imaging unit 15 b, whichincludes an imaging element 16 b, and an auxiliary light emitting unit13 b. Since configurations of the imaging unit 15 b and the auxiliarylight emitting unit 13 b are similar to those of the imaging unit 15 aand the auxiliary light emitting unit 13 a described above, detaileddescriptions thereof will be omitted. In addition, when the imagingdevices 10 a and 10 b are not particularly distinguished, they will besimply referred to as an “imaging device 10” below in some cases.Similarly, when the imaging units 15 a and 15 b are not particularlydistinguished, they will be simply referred to as an “imaging unit 15”in some cases. In addition, when the auxiliary light emitting units 13 aand 13 b are not particularly distinguished, they will be simplyreferred to as an “auxiliary light emitting unit 13” in some cases.

Note that, while the example in which the imaging devices 10 a and 10 battached to information processing devices 80 a and 80 b such as aso-called personal computer (PC) are linked to each other is shown inFIG. 1, configurations of the imaging devices 10 a and 10 b are notnecessarily limited thereto. As a specific example, the imaging devices10 a and 10 b may be configured as so-called monitoring cameras. Inaddition, as another example, the imaging devices 10 a and 10 b may be acomponent for capturing an image of a region in order for variousdevices such as a television device to detect a user in a predeterminedregion.

Here, in order to more easily understand characteristics of the controlsystem 1 according to the embodiment, first, challenges of the controlsystem 1 according to the embodiment will be summarized with referenceto FIG. 2. FIG. 2 is an explanatory diagram for describing an overviewof the control system 1 according to the embodiment and shows an exampleof an operation environment in which the imaging devices 10 a and 10 bare operated.

In FIG. 2, a reference sign r15 a schematically indicates a region (forexample, a region determined based on an angle of view of the imagingunit 15 a) that is captured as an image by the imaging unit 15 a of theimaging device 10 a. Also, the region indicated by the reference signr15 a will be referred to as “imaging region r15 a” below in some cases.In addition, a reference sign r13 a schematically indicates a regionthat is illuminated with auxiliary light (that is, auxiliary lightemitted from a light source of the auxiliary light emitting unit 13 a)emitted from the auxiliary light emitting unit 13 a.

Similarly, a reference sign r15 b schematically indicates a region (thatis, an imaging region) that is captured as an image by the imaging unit15 b of the imaging device 10 b. In addition, a reference sign r13 bschematically indicates a region that is illuminated with auxiliarylight that is emitted from the auxiliary light emitting unit 13 b.

In the example shown in FIG. 2, the region r13 b illuminated withauxiliary light emitted from the auxiliary light emitting unit 13 boverlaps the imaging region r15 a of the imaging unit 15 a. Therefore,in the example shown in FIG. 2, when the imaging unit 15 a captures animage of the imaging region r15 a, the imaging region r15 a isilluminated with auxiliary light emitted from the auxiliary lightemitting unit 13 b along with auxiliary light emitted from the auxiliarylight emitting unit 13 a.

That is, in the example shown in FIG. 2, in the imaging region r15 a,auxiliary light beams emitted from the auxiliary light emitting units 13a and 13 b interfere with each other, and an influence of theinterference is manifested on the image captured by the imaging unit 15a in some cases.

As a specific example, a so-called flicker phenomenon is exemplified.That is, auxiliary light beams emitted from the auxiliary light emittingunits 13 a and 13 b interfere with each other, and thus the interferenceis manifested as a flicker (that is, glimmer or fluctuation) on theimage captured by the imaging unit 15 a in some cases.

In addition, as another example, it is difficult for the imaging device10 a to properly control imaging conditions (for example, exposure andISO sensitivity) for the imaging unit 15 a to capture an image in somecases. Specifically, the imaging device 10 a may control imagingconditions (for example, exposure and ISO sensitivity) for the imagingunit 15 a to capture an image according to a light intensity ofauxiliary light emitted from the auxiliary light emitting unit 13 a. Inthis case, since the imaging region r15 a is also illuminated with theauxiliary light emitted from the auxiliary light emitting unit 13 b, theimage captured by the imaging unit 15 a may become an image havinghigher luminance (that is, a brighter image) than an image which wouldhave been rightfully captured based on control of the imaging device 10a. Accordingly, for example, at least a part of a region in the imagecaptured by the imaging unit 15 a may have saturated luminance,gradation of the region may be deteriorated, and thus a phenomenon of aso-called overexposure may occur.

That is, in view of the above-described object, an object of the controlsystem 1 according to the embodiment is to provide a mechanism throughwhich it is possible to implement a more suitable imaging environmenteven under a situation in which auxiliary light is emitted from aplurality of auxiliary light emitting units 13 (that is, light sources).

Specifically, the control system 1 according to the embodiment causes aplurality of auxiliary light emitting units 13 to emit auxiliary lightin a time-division manner, and causes the imaging units 15 associatedwith the auxiliary light emitting units 13 to capture an image insynchronization with a timing at which each of the auxiliary lightemitting units 13 emits auxiliary light. For example, FIG. 3 is anexplanatory diagram for describing schematic operations of the controlsystem 1 according to the embodiment. FIG. 3 shows an example of aschematic timing chart showing timings at which the auxiliary lightemitting units 13 a and 13 b emit auxiliary light and timings at whichthe imaging units 15 a and 15 b capture an image, and a lateraldirection corresponds to a time axis.

In the example shown in FIG. 3, timings at which the auxiliary lightemitting units 13 a and 13 b emit auxiliary light (that is, lightemission timings) are determined based on a common synchronizationsignal (for example, a control pulse).

Specifically, in the example shown in FIG. 3, the auxiliary lightemitting unit 13 a of the imaging device 10 a emits auxiliary light inperiods indicated by a reference sign T11. In addition, the auxiliarylight emitting unit 13 b of the imaging device 10 b emits auxiliarylight in periods (that is, in periods different from the period T11)indicated by a reference sign T12. That is, in a period indicated by areference sign T10, the auxiliary light emitting units 13 a and 13 b arecontrolled such that they emit auxiliary light at different timings(that is, emit auxiliary light in a time-division manner).

In addition, the imaging unit 15 a of the imaging device 10 a capturesan image in synchronization with a light emission timing of theauxiliary light emitting unit 13 a That is, in the example shown in FIG.3, the imaging unit 15 a is controlled such that it captures an image inthe period T11. Similarly, the imaging unit 15 b of the imaging device10 b captures an image in synchronization with a light emission timingof the auxiliary light emitting unit 13 b. That is, in the example shownin FIG. 3, the imaging unit 15 b is controlled such that it captures animage in the period T12.

In this case, for example, when a frame rate of the synchronizationsignal is set to 120 [fps], a frame rate at which each of the auxiliarylight emitting units 13 emits auxiliary light and a frame rate at whicheach of the imaging units 15 captures an image are set to 60 [fps].

According to such control, in the operation environment shown in FIG. 2,in a period during which the auxiliary light emitting unit 13 ailluminates the region r13 a with auxiliary light, the imaging unit 15 acaptures an image of the imaging region r15 a During this period, theauxiliary light emitting unit 13 b is controlled such that it does notemit auxiliary light. Similarly, in a period during which the auxiliarylight emitting unit 13 b illuminates the region r13 b with auxiliarylight, the imaging unit 15 b captures an image of the imaging region r15b. During this period, the auxiliary light emitting unit 13 a iscontrolled such that it does not emit auxiliary light.

In such a configuration, the control system 1 according to theembodiment can suppress interference of auxiliary light emitted from theplurality of auxiliary light emitting units 13 and cause each of theimaging units 15 to capture an image on which appropriate exposurecontrol is performed.

The overview of the control system 1 according to the embodiment hasbeen described above with reference to FIG. 1 to FIG. 3. In addition,the control system 1 according to the embodiment will be described infurther detail below.

1.2. Functional Configuration

An example of a functional configuration of the control system 1according to the embodiment will be described with reference to FIG. 4.FIG. 4 is a block diagram showing an example of a functionalconfiguration of the control system 1 according to the embodiment. Notethat description will focus particularly on functional configurations ofthe imaging devices 10 a and 10 b.

As shown in FIG. 4, the imaging device 10 a according to the embodimentincludes a control unit 11 a, the auxiliary light emitting unit 13 a,the imaging unit 15 a, and a communication unit 19. Note that theauxiliary light emitting unit 13 a and the imaging unit 15 a shown inFIG. 4 correspond to the auxiliary light emitting unit 13 a and theimaging unit 15 a shown in FIG. 1 to FIG. 3.

The control unit 11 a is a component for controlling operations of theauxiliary light emitting unit 13 a and the imaging unit 15 a. Note thatthe control unit 11 a will be separately described below in detail.

The communication unit 19 is an interface for components (in particular,the control unit 11 a) of the imaging device 10 a to transmit andreceive information to and from an external device that is connectedthrough a transfer path n11. Also, a form of the transfer path n11 isnot particularly limited as long as information can be transmitted andreceived between the imaging device 10 a and the external device (forexample, the imaging device 10 b).

As a specific example, the transfer path n11 may be configured as aso-called exclusive line. In this case, the communication unit 19 maycorrespond to an interface for connection to the transfer path n11configured as an exclusive line. In addition, the components of theimaging device 10 a transmit and receive a signal (for example, asynchronization signal indicating a synchronization timing) indicatinginformation serving as a transmission target to and from the externaldevice through the transfer path n11 configured as an exclusive line.

In addition, as another example, the transfer path n11 may be configuredas a wired or wireless network. In this case, the communication unit 19may correspond to a communication interface for communication with theexternal device via the network.

In addition, as long as information can be transmitted and receivedbetween the imaging device 10 a and the external device, a configurationand method for transmitting and receiving the information are notparticularly limited. For example, the imaging device 10 a may transmitand receive information to and from the external device throughso-called optical communication (for example, infrared communication)using light (for example, infrared light and visible light) of apredetermined band as a medium for transmitting and receivinginformation.

In addition, in the control system 1 shown in FIG. 4, when thecomponents of the imaging device 10 a transmit and receive informationto and from the external device through the transfer path n11 below, theinformation is transmitted and received through the communication unit19 even if this is not specifically described.

Similarly, the imaging device 10 b according to the embodiment includesa control unit 11 b, the auxiliary light emitting unit 13 b, the imagingunit 15 b, and the communication unit 19. In addition, the auxiliarylight emitting unit 13 b and the imaging unit 15 b shown in FIG. 4correspond to the auxiliary light emitting unit 13 b and the imagingunit 15 b shown in FIG. 1 to FIG. 3.

In addition, the control unit 11 b is a component for controllingoperations of the auxiliary light emitting unit 13 b and the imagingunit 15 b. Note that the control unit 11 b will be separately describedbelow in detail similarly to the control unit 11 a. In addition, whenthe control units 11 a and 11 b are not particularly distinguished, theywill be simply referred to as a “control unit 11” below in some cases.

In addition, since a configuration of the communication unit 19 in theimaging device 10 b is similar to that of the imaging device 10 a,detailed description thereof will be omitted. Also, in the controlsystem 1 shown in FIG. 4, when components of the imaging device 10 btransmit and receive information to and from an external device throughthe transfer path n11 below, the information is transmitted and receivedthrough the communication unit 19 even if this is not specificallydescribed.

In addition, as described above, the auxiliary light emitting unit 13may be provided outside the imaging device 10. Similarly, the imagingunit 15 may be provided outside the imaging device 10. In addition, somecomponents of the imaging unit 15 may be provided outside the imagingdevice 10. As a specific example, a configuration in which an imagingelement 16 such as an image sensor of the imaging unit 15 is provided inthe imaging device 10 and an optical system such as a lens is externallyattached to the outside of the imaging device 10 may be used and thusthe imaging device 10 may be configured as a so-called interchangeablelens type imaging device.

In addition, in the control system 1 according to the embodiment, amongthe plurality of imaging devices 10 (for example, the imaging devices 10a and 10 b), any imaging device 10 is operated as a master and the otherimaging devices 10 other than the master are operated as slaves.Therefore, between the imaging devices 10 a and 10 b shown in FIG. 4,the imaging device 10 a will be operated as a master and the imagingdevice 10 b will be operated as a slave below, and details ofconfigurations of the imaging devices 10 will be described with a focusparticularly on a configuration of the control unit 11.

(Master)

First, details of a configuration of the imaging device 10 a operated asa master will be described with a focus particularly on a configurationof the control unit 11 a. As shown in FIG. 4, the control unit 11 aaccording to the embodiment includes a state acquisition unit 111, anauxiliary light control unit 113, an imaging control unit 115, and amain control unit 117.

The state acquisition unit 111 of the imaging device 10 a acquirescontrol parameters for the auxiliary light emitting unit 13 a to emitauxiliary light from a predetermined acquisition source. Note that thecontrol parameters include setting information of, for example, a lightemission interval (for example, a frame rate) of auxiliary light that isemitted from the auxiliary light emitting unit 13 a, a range withinwhich the light emission interval is controllable, a light intensity ofauxiliary light, a range within which the light intensity iscontrollable, and a frequency of light that is emitted as auxiliarylight. In the control system 1 according to the embodiment, the stateacquisition unit 111 acquires at least a control parameter indicating alight emission interval (or a range within which the light emissioninterval is controllable) of auxiliary light that is emitted from theauxiliary light emitting unit 13 a.

Also, control parameters (in other words, settings) for the auxiliarylight emitting unit 13 a to emit auxiliary light directly or indirectlyindicate a state (hereinafter simply referred to as a “light emissionstate” in some case) when the auxiliary light emitting unit 13 a emitslight. Note that, hereinafter, states described as a light emissionstate of the auxiliary light emitting unit 13 a include a state in whichthe auxiliary light emitting unit 13 a actually emits auxiliary lightand settings in which the auxiliary light emitting unit 13 a emitsauxiliary light. That is, the state acquisition unit 111 according tothe embodiment acquires a light emission state of the auxiliary lightemitting unit 13 a based on the control parameters. This is similar tothe auxiliary light emitting unit 13 b.

In addition, as long as the state acquisition unit 111 of the imagingdevice 10 a can acquire control parameters for the auxiliary lightemitting unit 13 a to emit auxiliary light, an acquisition source of thecontrol parameters is not particularly limited. As a specific example,the control parameters may be stored in advance in a storage region (forexample, a storage region provided within the imaging device 10 a) whichis readable by the state acquisition unit 111. In addition, as anotherexample, the state acquisition unit 111 may acquire the controlparameters as a user input. In this case, a manipulation interface for auser to set control parameters may be provided in the imaging device 10a. In addition, as still another example, the state acquisition unit 111may acquire the control parameters from an external device connected viaa network.

In addition, the state acquisition unit 111 of the imaging device 10 aacquires control parameters for the auxiliary light emitting unit 13 bto emit auxiliary light from the imaging device 10 b through thetransfer path n11. In this case, the state acquisition unit 111instructs the imaging device 10 b to transmit control parameters andthus may actively acquire the control parameters from the imaging device10 b. Also, as another example, the state acquisition unit 111 may awaittransmission of control parameters from the imaging device 10 b and thusmay passively acquire the control parameters from the imaging device 10b.

Note that, in this case, the state acquisition unit 111 of the imagingdevice 10 a confirms an operation state of the imaging device 10 bserving as a link target based on communication through the transferpath n11, and only when the imaging device 10 b is operated, may acquirecontrol parameters from the imaging device 10 b.

In addition, control parameters for the auxiliary light emitting unit 13b to emit auxiliary light directly or indirectly indicate a “lightemission state” of the auxiliary light emitting unit 13 b. That is, thestate acquisition unit 111 according to the embodiment acquires a lightemission state of the auxiliary light emitting unit 13 b based on thecontrol parameters.

As described above, the state acquisition unit 111 of the imaging device10 a acquires light emission states of the auxiliary light emittingunits 13 a and 13 b (for example, light emission intervals of theauxiliary light emitting units 13 a and 13 b), and outputs the acquiredlight emission states of the auxiliary light emitting units 13 a and 13b to the main control unit 117.

The main control unit 117 of the imaging device 10 a acquires lightemission states of the auxiliary light emitting units 13 a and 13 b (forexample, light emission intervals of the auxiliary light emitting units13 a and 13 b) from the state acquisition unit 111. Then, the maincontrol unit 117 generates a synchronization signal for connectingtimings at which the auxiliary light emitting units 13 a and 13 b emitauxiliary light based on the acquired light emission states of theauxiliary light emitting units 13 a and 13 b. For example, FIG. 3 showsan example of the synchronization signal that is generated by the maincontrol unit 117.

When the synchronization signal is generated, the main control unit 117sets light emission timings of the auxiliary light emitting units 13 aand 13 b such that the auxiliary light emitting units 13 a and 13 b emitauxiliary light at different timings (that is, auxiliary light beams areemitted in a time-division manner).

Specifically, in the example shown in FIG. 3, the main control unit 117divides the period T10 into the period T11 and the period T12, andallocates a light emission timing of the auxiliary light emitting unit13 a to the period T11 (for example, in odd frames). In addition, themain control unit 117 allocates a light emission timing of the auxiliarylight emitting unit 13 b to the period T12 (for example, in evenframes).

In addition, the main control unit 117 of the imaging device 10 a mayalso set timings at which the imaging units 15 a and 15 b capture animage. In this case, the main control unit 117 sets the imaging timingof the imaging unit 15 a (for example, allocates it to the period T11)such that the imaging unit 15 a captures an image in synchronizationwith a light emission timing of the auxiliary light emitting unit 13 a.Similarly, the main control unit 117 sets the imaging timing of theimaging unit 15 b (for example, allocates it to the period T12) suchthat the imaging unit 15 b captures an image in synchronization with alight emission timing of the auxiliary light emitting unit 13 b.

Then, the main control unit 117 of the imaging device 10 a supplies acontrol signal (for example, a control pulse) to the auxiliary lightcontrol unit 113 according to the set light emission timing of theauxiliary light emitting unit 13 a. The auxiliary light control unit 113controls an operation of the auxiliary light emitting unit 13 a emittingauxiliary light based on the control signal supplied from the maincontrol unit 117.

Also, the auxiliary light control unit 113 of the imaging device 10 a isa component for controlling an operation of the auxiliary light emittingunit 13 a emitting auxiliary light (for example, controlling at leastany of a light emission timing of auxiliary light, a light emissiontime, and an amount of light emission). In particular, the auxiliarylight control unit 113 according to the embodiment controls a lightemission timing of the auxiliary light emitting unit 13 a insynchronization with the control signal supplied from the main controlunit 117. In this case, the auxiliary light control unit 113 may controla light emission time of the auxiliary light emitting unit 13 a based onthe supplied control signal.

In addition, the main control unit 117 of the imaging device 10 asupplies a control signal (for example, a control pulse) to the imagingcontrol unit 115 according to the set imaging timing of the imaging unit15 a. The imaging control unit 115 controls an operation of the imagingunit 15 a capturing an image based on the control signal supplied fromthe main control unit 117.

Also, the imaging control unit 115 of the imaging device 10 a is acomponent for controlling an operation of the imaging unit 15 acapturing an image (controlling, for example, an imaging timing, animaging time, and exposure conditions). In particular, the imagingcontrol unit 115 according to the embodiment controls the imaging timingof the imaging unit 15 a in synchronization with the control signalsupplied from the main control unit 117. In this case, the imagingcontrol unit 115 may control the imaging time of the imaging unit 15 abased on the supplied control signal.

As described above, when operations of the auxiliary light emitting unit13 a and the imaging unit 15 a are controlled based on the controlsignal from the main control unit 117, a light emission timing of theauxiliary light emitting unit 13 a and an imaging timing of the imagingunit 15 a are synchronized.

In addition, the main control unit 117 of the imaging device 10 anotifies the imaging device 10 b of control information indicating theset light emission timing of the auxiliary light emitting unit 13 b andthe set imaging timing of the imaging unit 15 b through the transferpath n11. Accordingly, the imaging device 10 b can control a lightemission timing of the auxiliary light emitting unit 13 b and an imagingtiming of the imaging unit 15 b based on the control information.

Note that, as long as the imaging device 10 b can recognize a lightemission timing of the auxiliary light emitting unit 13 b and an imagingtiming of the imaging unit 15 b, a kind and content of controlinformation of which the main control unit 117 notifies the imagingdevice 10 b are not particularly limited. For example, the main controlunit 117 may transmit a control signal (for example, a control pulse)indicating a light emission timing of the auxiliary light emitting unit13 b and an imaging timing of the imaging unit 15 b to the imagingdevice 10 b through the transfer path n11.

Details of the configuration of the imaging device 10 a operated as amaster have been described above with a focus particularly on theconfiguration of the control unit 11 a.

(Slave)

Next, details of a configuration of the imaging device 10 b operated asa slave will be described with a focus particularly on a configurationof the control unit 11 b. As shown in FIG. 4, the control unit 11 baccording to the embodiment includes the state acquisition unit 111, theauxiliary light control unit 113, the imaging control unit 115, and themain control unit 117.

The state acquisition unit 111 of the imaging device 10 b acquirescontrol parameters for the auxiliary light emitting unit 13 b to emitauxiliary light from a predetermined acquisition source. In addition,since details of control parameters and an acquisition source of thecontrol parameters are similar to those of the imaging device 10 adescribed above, details thereof will not be described. In addition, inthe control system 1 according to the embodiment, the state acquisitionunit 111 acquires at least a control parameter indicating a lightemission interval (or a range within which the light emission intervalis controllable) of auxiliary light that is emitted from the auxiliary)light emitting unit 13 b.

The state acquisition unit 111 of the imaging device 10 b transmits theacquired control parameters to the imaging device 10 a through thetransfer path n11. Also, in this case, the state acquisition unit 111may passively transmit the control parameters to the imaging device 10 abased on an instruction from the imaging device 10 a. In addition, asanother example, the state acquisition unit 111 may actively transmit(for example, push transmit) the control parameters to the imagingdevice 10 a at a timing (for example, a timing at which controlparameters are acquired or a timing at which the imaging device 10 bstarts) that is determined in advance.

The main control unit 117 of the imaging device 10 b acquires controlinformation indicating a light emission timing of the auxiliary lightemitting unit 13 b and an imaging timing of the imaging unit 15 b fromthe imaging device 10 b in response to transmission of controlparameters from the state acquisition unit 111 to the imaging device 10a.

The main control unit 117 of the imaging device 10 b recognizes a lightemission timing of the auxiliary light emitting unit 13 b based on theacquired control information and supplies a control signal (for example,a control pulse) to the auxiliary light control unit 113 according tothe light emission timing. The auxiliary light control unit 113 controlsan operation of the auxiliary light emitting unit 13 b emittingauxiliary light based on the control signal supplied from the maincontrol unit 117.

Note that the auxiliary light control unit 113 of the imaging device 10b corresponds to the auxiliary light control unit 113 in the imagingdevice 10 a and is a component for controlling an operation of theauxiliary light emitting unit 13 b emitting auxiliary light. Inparticular, the auxiliary light control unit 113 according to theembodiment controls a light emission timing of the auxiliary lightemitting unit 13 b in synchronization with the control signal suppliedfrom the main control unit 117. In this case, the auxiliary lightcontrol unit 113 may control a light emission time of the auxiliarylight emitting unit 13 b based on the supplied control signal.

In addition, the main control unit 117 of the imaging device 10 brecognizes an imaging timing of the imaging unit 15 b based on theacquired control information and supplies a control signal (for example,a control pulse) to the imaging control unit 115 according to theimaging timing. The imaging control unit 115 controls an operation ofthe imaging unit 15 b capturing an image based on the control signalsupplied from the main control unit 117.

Also, the imaging control unit 115 of the imaging device 10 bcorresponds to the imaging control unit 115 in the imaging device 10 aand is a component for controlling an operation of the imaging unit 15 bcapturing an image. In particular, the imaging control unit 115according to the embodiment controls an imaging timing of the imagingunit 15 b in synchronization with the control signal supplied from themain control unit 117. In this case, the imaging control unit 115 maycontrol an imaging time of the imaging unit 15 b based on the suppliedcontrol signal.

As described above, when operations of the auxiliary light emitting unit13 b and the imaging unit 15 b are controlled based on the controlsignal from the main control unit 117, a light emission timing of theauxiliary light emitting unit 13 b and an imaging timing of the imagingunit 15 b are synchronized. In addition, in this case, the auxiliarylight emitting units 13 a and 13 b are controlled such that they emitauxiliary light at different timings (that is, auxiliary light beams areemitted in a time-division manner).

As described above, the control system 1 according to the embodimentperforms control such that the auxiliary light emitting units 13 a and13 b emit auxiliary light at different timings (that is, auxiliary lightbeams are emitted in a time-division manner). In such a configuration,the control system 1 according to the embodiment can prevent occurrenceof a situation in which auxiliary light beams emitted from the auxiliarylight emitting units 13 a and 13 b interfere with each other and preventan influence of the interference from being manifested. That is,according to the control system 1 of the embodiment, it is possible toimplement a more suitable imaging environment even under a situation inwhich auxiliary light is emitted from the plurality of auxiliary lightemitting units 13 (that is, light sources).

Note that the example in which the main control unit 117 sets a lightemission timing of the auxiliary light emitting unit 13 and an imagingtiming of the imaging unit 15 has been described above. However, as longas a light emission timing of the auxiliary light emitting unit 13 andan imaging timing of the imaging unit 15 are synchronized, a maincomponent for controlling an imaging timing of the imaging unit 15 isnot necessarily limited to the main control unit 117. For example, theauxiliary light control unit 113 may be synchronized with a lightemission timing of the auxiliary light emitting unit 13 and thus maycause the imaging control unit 115 to control an operation of theimaging unit 15. In addition, as another example, the imaging controlunit 115 may recognize an imaging timing of the imaging unit 15 based ona control signal indicating a light emission timing of the auxiliarylight emitting unit 13.

In addition, as still another example, the imaging device 10 a operatedas a master may set a timing at which the auxiliary light emitting unit13 of each of the imaging devices 10 emits auxiliary light based on asynchronization signal supplied from another external device that isdifferent from each of the imaging devices 10. In this case, the imagingdevice 10 a may recognize a light emission timing of the auxiliary lightemitting unit 13 b of the imaging device 10 b operated as a slave as a“light emission state” of the auxiliary light emitting unit 13 b basedon the supplied synchronization signal. In addition, as yet anotherexample, the imaging device 10 a may recognize a timing that isdifferent from a light emission timing of the auxiliary light emittingunit 13 a whose operation is controlled by the imaging device 10 aitself within the supplied synchronization signal as a light emissiontiming of the auxiliary light emitting unit 13 b of the imaging device10 b operated as a slave.

Also, as long as the state acquisition unit 111 of the imaging device 10operated as a master can directly or indirectly acquire a light emissionstate of the auxiliary light emitting unit 13 of each of the imagingdevices 10, details of control parameters that are transmitted andreceived between the imaging devices 10 are not particularly limited. Asa specific example, a configuration in which identification informationfor specifying a light emission state of the auxiliary light emittingunit 13 is transmitted and received between the imaging devices 10 ascontrol parameters may be used.

In this case, for example, data in which specific information (forexample, a light emission interval of auxiliary light) indicating alight emission state of the auxiliary light emitting unit 13 of each ofthe imaging devices 10 and identification information of the imagingdevice 10 are associated may be stored in a position which is readableby the state acquisition unit 111 of the imaging device 10 operated as amaster. Then, the state acquisition unit 111 acquires identificationinformation from each of the imaging devices 10 as control parameters,checks the acquired identification information and the data, and thusmay acquire a light emission state of the auxiliary light emitting unit13 of the imaging device 10.

In addition, the imaging device 10 a operated as a master notifies theimaging device 10 b operated as a slave of control informationindicating a light emission timing of the auxiliary light emitting unit13 and also may instruct the imaging device 10 b to change controlparameters of the auxiliary light emitting unit 13. As a specificexample, when a light emission interval of the auxiliary light emittingunit 13 a that is controlled by the imaging device 10 a itself and alight emission interval of the auxiliary light emitting unit 13 b thatis controlled by the imaging device 10 b are different, the imagingdevice 10 a may instruct the imaging device 10 b to change the lightemission interval of the auxiliary light emitting unit 13 b.

In addition, while the example in which, among the plurality of imagingdevices 10, any of the imaging devices 10 is operated as a master andanother imaging device 10 other than the master is operated as a slavehas been described above, the control system 1 may have a configurationin which the plurality of imaging devices 10 are individuallyindependently operated. In this case, for example, the plurality ofimaging devices 10 may share light emission states of the auxiliarylight emitting units 13 and control an operation (for example, a lightemission timing and a light emission time) of their own auxiliary lightemitting units 13 according to a light emission state (for example, alight emission timing and a light emission time) of the auxiliary lightemitting unit 13 of a partner.

1.3. Processes

Next, an example of a flow of a series of processes of the controlsystem 1 according to the embodiment will be described with reference toFIG. 5 with a focus particularly on operations of the imaging device 10a operated as a master. FIG. 5 is a flowchart showing an example of aflow of a series of processes of the control system 1 according to theembodiment.

(Step S101)

First, the state acquisition unit 111 of the imaging device 10 aconfirms an operation state of the imaging device 10 b serving as a linktarget based on communication through the transfer path n11.

(Step S103)

When the imaging device 10 b serving as a link target is operated, thestate acquisition unit 111 of the imaging device 10 a acquires controlparameters for the auxiliary light emitting unit 13 b to emit auxiliarylight from the imaging device 10 b through the transfer path n11.

In addition, in the control system 1 according to the embodiment, thestate acquisition unit 111 acquires at least a control parameterindicating a light emission interval (or a range within which the lightemission interval is controllable) of auxiliary light that is emittedfrom the auxiliary light emitting unit 13 b from the imaging device 10b.

In addition, in this case, the state acquisition unit 111 instructs theimaging device 10 b to transmit control parameters and thus may activelyacquire the control parameters from the imaging device 10 b. Also, asanother example, the state acquisition unit 111 may await transmissionof control parameters from the imaging device 10 b and thus maypassively acquire the control parameters from the imaging device 10 b.

Note that control parameters for the auxiliary light emitting unit 13 bto emit auxiliary light directly or indirectly indicate a light emissionstate of the auxiliary light emitting unit 13 b. That is, the stateacquisition unit 111 according to the embodiment acquires a lightemission state of the auxiliary light emitting unit 13 b based on thecontrol parameters.

In addition, the state acquisition unit 111 of the imaging device 10 aacquires control parameters for the auxiliary light emitting unit 13 ato emit auxiliary light from a predetermined acquisition source.

Note that, as long as the state acquisition unit 111 of the imagingdevice 10 a can acquire control parameters for the auxiliary lightemitting unit 13 a to emit auxiliary light, an acquisition source of thecontrol parameters is not particularly limited. As a specific example,the control parameters may be stored in advance in a storage region (forexample, a storage region provided within the imaging device 10 a) whichis readable by the state acquisition unit 111.

Note that control parameters for the auxiliary light emitting unit 13 ato emit auxiliary light directly or indirectly indicate a light emissionstate of the auxiliary light emitting unit 13 a. That is, the stateacquisition unit 111 according to the embodiment acquires a lightemission state of the auxiliary light emitting unit 13 a based on thecontrol parameters.

As described above, the state acquisition unit 111 of the imaging device10 a acquires light emission states of the auxiliary light emittingunits 13 a and 13 b (for example, light emission intervals of theauxiliary light emitting units 13 a and 13 b), and outputs the acquiredlight emission states of the auxiliary light emitting units 13 a and 13b to the main control unit 117.

(Step S105)

The main control unit 117 acquires light emission states of theauxiliary light emitting units 13 a and 13 b (for example, lightemission intervals of the auxiliary light emitting units 13 a and 13 b)from the state acquisition unit 111. Then, the main control unit 117generates a synchronization signal for connecting timings at which theauxiliary light emitting units 13 a and 13 b emit auxiliary light basedon the acquired light emission states of the auxiliary light emittingunits 13 a and 13 b.

When the synchronization signal is generated, the main control unit 117sets light emission timings of the auxiliary light emitting units 13 aand 13 b such that the auxiliary light emitting units 13 a and 13 b emitauxiliary light at different timings (that is, auxiliary light beams areemitted in a time-division manner).

In addition, the main control unit 117 may also set timings at which theimaging units 15 a and 15 b capture an image. In this case, the maincontrol unit 117 sets the imaging timing of the imaging unit 15 a suchthat the imaging unit 15 a captures an image in synchronization with alight emission timing of the auxiliary light emitting unit 13 a.Similarly, the main control unit 117 sets the imaging timing of theimaging unit 15 b such that the imaging unit 15 b captures an image insynchronization with a light emission timing of the auxiliary lightemitting unit 13 b.

(Step S107)

Then, the main control unit 117 of the imaging device 10 a supplies acontrol signal (for example, a control pulse) to the auxiliary lightcontrol unit 113 according to the set light emission timing of theauxiliary light emitting unit 13 a. The auxiliary light control unit 113controls an operation of the auxiliary light emitting unit 13 a emittingauxiliary light based on the control signal supplied from the maincontrol unit 117.

In addition, the main control unit 117 of the imaging device 10 asupplies a control signal (for example, a control pulse) to the imagingcontrol unit 115 according to the set imaging timing of the imaging unit15 a. The imaging control unit 115 controls an operation of the imagingunit 15 a capturing an image based on the control signal supplied fromthe main control unit 117.

As described above, when operations of the auxiliary light emitting unit13 a and the imaging unit 15 a are controlled based on the controlsignal from the main control unit 117, a light emission timing of theauxiliary light emitting unit 13 a and an imaging timing of the imagingunit 15 a are synchronized.

In addition, the main control unit 117 of the imaging device 10 anotifies the imaging device 10 b of control information indicating theset light emission timing of the auxiliary light emitting unit 13 b andthe set imaging timing of the imaging unit 15 b through the transferpath n11. Accordingly, the imaging device 10 b can control a lightemission timing of the auxiliary light emitting unit 13 b and an imagingtiming of the imaging unit 15 b based on the control information.

The example of a flow of a series of processes of the control system 1according to the embodiment has been described above with reference toFIG. 5 with a focus particularly on operations of the imaging device 10a operated as a master.

1.4. Modified Examples

Next, modified examples of the control system 1 according to theembodiment will be described.

1.4.1. Modified Example 1: Control when Three or More Imaging Devicesare Operated

First, as Modified Example 1, an example of control when three or moreimaging devices 10 are operated will be described with reference to FIG.6. FIG. 6 is an explanatory diagram for describing an overview of thecontrol system 1 according to Modified Example 1. Specifically, FIG. 6shows an example of a schematic timing chart of timings at which theauxiliary light emitting units 13 a to 13 d of the imaging devices 10 ato 10 d emit auxiliary light when the different imaging devices 10 a to10 d are operated.

In the example shown in FIG. 6, a period indicated by a reference signT20 is divided into a plurality of different periods T21 to T24, anddifferent light emission timings of the auxiliary light emitting units13 are allocated to the periods T21 to T24.

Specifically, in the period T21, the auxiliary light emitting unit 13 aof the imaging device 10 a emits auxiliary light and the imaging unit 15a of the imaging device 10 a captures an image in synchronization with atiming at which the auxiliary light is emitted (that is, a lightemission timing of the auxiliary light emitting unit 13 a). In thiscase, the auxiliary light emitting units 13 b to 13 d of the imagingdevices 10 b to 10 d are controlled such that they do not emit auxiliarylight.

In addition, in the period T22, the auxiliary light emitting unit 13 bof the imaging device 10 b emits auxiliary light and the imaging unit 15b of the imaging device 10 b captures an image in synchronization with atiming at which the auxiliary light is emitted (that is, a lightemission timing of the auxiliary light emitting unit 13 b). Note that,in this case, the auxiliary light emitting units 13 a. 13 c, and 13 d ofthe imaging devices 10 a. 10 c, and 10 d are controlled such that theydo not emit auxiliary light.

Similarly, operations of the auxiliary light emitting units 13 arecontrolled such that only the auxiliary light emitting unit 13 c of theimaging device 10 c emits auxiliary light in the period T23 and only theauxiliary light emitting unit 13 d of the imaging device 10 d emitsauxiliary light in the period T24.

In this case, for example, when a frame rate of the synchronizationsignal is set to 120 [fps], a frame rate at which each of the auxiliarylight emitting units 13 emits auxiliary light and a frame rate at whicheach of the imaging units 15 captures an image are set to 30 [fps].

Note that a main component for controlling a light emission timing ofthe auxiliary light emitting unit 13 of each of the imaging devices 10is not particularly limited. As a specific example, any of the imagingdevices 10 a to 10 d may be set as a master, and the imaging device 10operated as a master may control light emission timings of the auxiliarylight emitting units 13 of the other imaging devices 10 operated asslaves.

Also, as another example, a configuration in which the imaging devices10 a to 10 d are independently operated may be used. In this case, forexample, the imaging devices 10 a to 10 d may share (for example, notifyeach other of) light emission states of the auxiliary light emittingunits 13 and control operations (for example, a light emission timingand a light emission time) of their own auxiliary light emitting units13 according to a light emission state (for example, a light emissiontiming and a light emission time) of the auxiliary light emitting unit13 of a partner.

That is, the auxiliary light emitting units 13 a to 13 d are controlledsuch that they emit auxiliary light at different timings (that is,auxiliary light beams are emitted in a time-division manner) based oncontrol timings shown in FIG. 6. Accordingly, it is possible to preventoccurrence of a situation in which auxiliary light beams emitted fromthe auxiliary light emitting units 13 of the imaging devices 10interfere with each other even when three or more imaging devices 10 arelinked to one another.

Note that, when three or more imaging devices 10 are operated as in thecontrol system 1 according to Modified Example 1, not all of theauxiliary light emitting units 13 of the imaging device 10 arenecessarily controlled such that they emit auxiliary light in atime-division manner.

For example, FIG. 7 is an explanatory diagram for describing an overviewof the control system 1 according to Modified Example 1 and shows anexample of an operation environment in which 10 a to 10 c are operated.

In FIG. 7, a reference sign r15 a schematically indicates an imagingregion of the imaging unit 15 a of the imaging device 10 a. Similarly, areference sign r15 b schematically indicates an imaging region of theimaging unit 15 b of the imaging device 10 b. In addition, a referencesign r15 c schematically indicates an imaging region of the imaging unit15 c of the imaging device 10 c.

In addition, a reference sign r13 a schematically indicates a regionthat is illuminated with auxiliary light emitted from the auxiliarylight emitting unit 13 a. Similarly, a reference sign r13 bschematically indicates a region that is illuminated with auxiliarylight emitted from the auxiliary light emitting unit 13 b. In addition,a reference sign r13 c schematically indicates a region that isilluminated with auxiliary light emitted from the auxiliary lightemitting unit 13 c.

In the example shown in FIG. 7, the region r13 b illuminated withauxiliary light emitted from the auxiliary light emitting unit 13 boverlaps the imaging region r15 a of the imaging unit 15 a. Therefore,in the example shown in FIG. 7, when the imaging unit 15 a captures animage of the imaging region r15 a, the imaging region r15 a isilluminated with auxiliary light emitted from the auxiliary lightemitting unit 13 a along with the auxiliary light emitted from theauxiliary light emitting unit 13 a.

Similarly, the region r13 a illuminated with auxiliary light emittedfrom the auxiliary light emitting unit 13 a overlaps the imaging regionr15 b of the imaging unit 15 b. Therefore, in the example shown in FIG.7, when the imaging unit 15 b captures an image of the imaging region rl5 b, the imaging region r15 b is illuminated with auxiliary lightemitted from the auxiliary light emitting unit 13 a along with auxiliarylight emitted from the auxiliary light emitting unit 13 b.

That is, in the example shown in FIG. 7, in the imaging regions rl 5 aand r15 b, auxiliary light beams emitted from the auxiliary lightemitting units 13 a and 13 b interfere with each other, and an influenceof the interference is manifested on images captured by the imagingunits 15 a and 15 b in some cases.

On the other hand, the region r13 c illuminated with auxiliary lightemitted from the auxiliary light emitting unit 13 c does not overlap theimaging regions r15 a and r15 b of the imaging units 15 a and 15 b. Thatis, when the imaging unit 15 a captures an image of the imaging regionr15 a, if auxiliary light is emitted from the auxiliary light emittingunit 13 c, the imaging region r15 a is not illuminated with theauxiliary light. This is similar to a case in which the imaging unit 15b captures an image of the imaging region r15 b.

Therefore, in the configuration shown in FIG. 7, it is not necessary tocontrol the auxiliary light emitting unit 13 c to always emit auxiliarylight together with the auxiliary light emitting units 13 a and 13 b ina time-division manner. That is, when the plurality of imaging devices10 are linked to one another, at least only the imaging devices 10 forwhich auxiliary light beams emitted from the auxiliary light emittingunits 13 interfere with each other may be linked, but it is notnecessary to always link all of the imaging devices 10. In other words,it is not necessary to always link the imaging devices 10 for whichauxiliary light beams emitted from the auxiliary light emitting units 13do not interfere with each other.

Note that some of the plurality of imaging devices 10 that will belinked may be determined in advance, for example, based on previoussettings.

Also, as another example, any (for example, a master) of the pluralityof imaging devices 10 may identify the imaging devices 10 to be linkedaccording to positions in which the imaging devices 10 are installed andorientations thereof.

Specifically, it is possible to estimate an imaging region of theimaging unit 15 based on an installation position and an orientation ofthe imaging device 10 and an angle of view of the imaging unit 15. Inaddition, it is possible to estimate a region illuminated with auxiliarylight emitted from the auxiliary light emitting unit 13 based on theinstallation position and the orientation of the imaging device 10 and aradiation angle of the auxiliary light emitting unit 13.

That is, in this case, for example, the imaging device 10 operated as amaster acquires information indicating positions and orientations of theimaging devices 10, information indicating angles of view of the imagingunits 15 of the imaging devices 10, and information indicating radiationangles of the auxiliary light emitting units 13 of the imaging devices10 from the imaging devices 10. Then, the imaging device 10 operated asa master specifies a plurality of imaging devices 10 in which auxiliarylight beams interfere with each other based on the acquired informationof the imaging devices 10, and may identify the specified plurality ofimaging devices 10 as the imaging devices 10 to be linked to oneanother.

Also, as another example, the plurality of imaging devices 10 may share(for example, notify each other of) information (that is, informationindicating a position and an orientation, an angle of view of theimaging unit 15, and a radiation angle of the auxiliary light emittingunit 13), and may identify another imaging device 10 for which a link isnecessary. In this case, each of the imaging devices 10 specifiesanother imaging device 10 that emits auxiliary light toward an imagingregion of its own imaging unit 15 based on information acquired from theother imaging device 10, and may recognize the specified imaging device10 as a link target.

In addition, as still another example, each of the plurality of imagingdevices 10 may specify another imaging device 10 serving as a linktarget based on a state related to emission of auxiliary light from eachof the imaging devices 10 and an image captured by its own imaging unit15.

Specifically, any (for example, a master) of the plurality of imagingdevices 10 sequentially emits auxiliary light toward the imaging devices10 in a time-division manner, notifies the imaging devices 10 ofinformation of the imaging device 10 that emits the auxiliary light, andcauses the imaging devices 10 to capture an image in synchronizationwith emission of the auxiliary light.

Each of the imaging devices 10 analyzes an image captured by its ownimaging unit 15, and determines whether an imaging region of its ownimaging unit 15 is illuminated according to emission of auxiliary lightfrom another imaging device 10. Then, each of the imaging devices 10identifies the other imaging device 10 that emits auxiliary light basedon information notified of when the imaging region of its own imagingunit 15 is illuminated and may identify the other imaging device 10 as alink target.

The example of control when three or more imaging devices 10 areoperated has been described above as Modified Example 1 with referenceto FIG. 6 and FIG. 7.

1.4.2. Modified Example 2: Example of System Configuration

Next, as Modified Example 2, an example of a system configuration of acontrol system 1 according to the embodiment will be described withreference to FIG. 8. FIG. 8 is a block diagram showing an example of aconfiguration of a control system according to Modified Example 2. Notethat, when a control system according to Modified Example 2 isdistinguished from the control system 1 according to the above-describedembodiment, it will be referred to as a “control system 2” below in somecases.

In the control system 1 according to the above-described embodiment,each of the imaging devices 10 includes the control unit 11, and thecontrol unit 11 controls operations of the auxiliary light emitting unit13 and the imaging unit 15 of the imaging device 10. On the other hand,in the control system 2 according to Modified Example 2, as shown inFIG. 8, the control device 20 is provided, and the control device 20controls operations of the auxiliary light emitting unit 13 and theimaging unit 15 of each imaging device. Therefore, the control system 2according to Modified Example 2 will be described below in detail. Notethat, in this description, in order to distinguish an imaging deviceaccording to Modified Example 2 from the imaging device 10 according tothe above-described embodiment, it will be referred to as an “imagingdevice 30” in some cases.

As shown in FIG. 8, the control system 2 according to Modified Example 2includes a control device 20 and a plurality of imaging devices 30. Notethat, in this description, the control system 2 including imagingdevices 30 a and 30 b as shown in FIG. 8 as the plurality of imagingdevices 30 is described, but the number of imaging devices 30 is notnecessarily limited to two. In addition, since the imaging devices 30 aand 30 b have the same configuration, the imaging device 30 a will bedescribed in detail, and details of the configuration of the imagingdevice 30 b will not be described.

The imaging device 30 a includes the auxiliary light emitting unit 13 a,the imaging unit 15 a, the communication unit 19, an auxiliary lightcontrol unit 33, and the imaging control unit 35. Note that theauxiliary light emitting unit 13 a and the imaging unit 15 a correspondto the auxiliary light emitting unit 13 a and the imaging unit 15 aaccording to the above-described embodiment (refer to FIG. 4).

In addition, the communication unit 19 is an interface for the auxiliarylight emitting unit 13 a and the imaging unit 15 a to transmit andreceive information to and from an external device (for example, thecontrol device 20) connected through the transfer path n11. Also, aslong as the auxiliary light emitting unit 13 a and the imaging unit 15 acan transmit and receive information to and from the external deviceconnected through the transfer path n11, a form of the transfer pathn11, a configuration of the communication unit 19 and a communicationmethod are not particularly limited. Note that, when the auxiliary lightemitting unit 13 a and the imaging unit 15 a transmit and receiveinformation to and from the external device through the transfer pathn11 below, the information is transmitted and received through thecommunication unit 19 even if this is not specifically described.

The auxiliary light control unit 33 is a component for controlling anoperation of the auxiliary light emitting unit 13 a emitting auxiliarylight, and corresponds to the auxiliary light control unit 113 accordingto the above-described embodiment (refer to FIG. 4). That is, theauxiliary light control unit 33 controls a light emission timing of theauxiliary light emitting unit 13 a based on a control signal suppliedfrom the control device 20 to be described below. In this case, theauxiliary light control unit 33 may control a light emission time of theauxiliary light emitting unit 13 a based on the supplied control signal.

The imaging control unit 35 is a component for controlling an operationof the imaging unit 15 a capturing an image and corresponds to theimaging control unit 115 according to the above-described embodiment(refer to FIG. 4). That is, the imaging control unit 35 controls animaging timing of the imaging unit 15 a based on a control signalsupplied from the control device 20 to be described below. In this case,the imaging control unit 35 may control an imaging time of the imagingunit 15 a based on the supplied control signal.

The control device 20 includes a control unit 21 and a communicationunit 29. In addition, the control unit 21 includes a state acquisitionunit 211 and a main control unit 217. Note that the state acquisitionunit 211 and the main control unit 217 according to Modified Example 2correspond to the state acquisition unit 111 and the main control unit117 according to the above-described embodiment (refer to FIG. 4).

The communication unit 29 is an interface for components within thecontrol device 20 to transmit and receive information to and from anexternal device (for example, the imaging devices 30 a and 30 b)connected through the transfer path n11. Note that, as long as thecomponents within the control device 20 can transmit and receiveinformation to and from the external device connected through thetransfer path n11, a form of the transfer path n11, a configuration ofthe communication unit 29, and a communication method are notparticularly limited. In addition, when the components within thecontrol device 20 transmit and receive information to and from theexternal device through the transfer path n11 below, the information istransmitted and received through the communication unit 29 even if thisis not specifically described.

The state acquisition unit 211 acquires light emission states of theauxiliary light emitting units 13 a and 13 b from a predeterminedacquisition source. Also, as light emission states of the auxiliarylight emitting units 13 a and 13 b, similarly to the control system 1according to the above-described embodiment, for example, controlparameters (for example, for indicating a light emission interval ofauxiliary light) for the auxiliary light emitting units 13 a and 13 b toemit auxiliary light are exemplified.

In addition, as long as the state acquisition unit 211 can acquire lightemission states of the auxiliary light emitting units 13 a and 13 b, anacquisition source of the light emission state is not particularlylimited. As a specific example, light emission states of the auxiliarylight emitting units 13 a and 13 b may be stored in advance in a storageregion (for example, a storage region provided within the control device20) which is readable by the state acquisition unit 211. Also, asanother example, the state acquisition unit 211 may acquire lightemission states of the auxiliary light emitting units 13 a and 13 b as auser input. In this case, a manipulation interface for a user to setcontrol parameters may be provided in the control device 20. Inaddition, as still another example, the state acquisition unit 211 mayacquire light emission states of the auxiliary light emitting units 13 aand 13 b from an external device connected via a network.

Also, as still another example, a light emission state of the auxiliarylight emitting unit 13 may be stored in advance, by the auxiliary lightemitting unit 13 itself, or in the imaging device 30 with which theauxiliary light emitting unit 13 is associated (for example, attached).In this case, the state acquisition unit 211 may acquire a lightemission state of the auxiliary light emitting unit 13 from the imagingdevice 30 with which the auxiliary light emitting unit 13 is associatedthrough the transfer path n11.

As described above, the state acquisition unit 211 acquires lightemission states of the auxiliary light emitting units 13 a and 13 b (forexample, light emission intervals of the auxiliary light emitting units13 a and 13 b) and outputs the acquired light emission states of theauxiliary light emitting units 13 a and 13 b to the main control unit217.

Also, operations of the main control unit 217 are similar to those ofthe main control unit 117 according to the above-described embodiment(refer to FIG. 4). That is, the main control unit 217 generates asynchronization signal for connecting timings at which the auxiliarylight emitting units 13 a and 13 b emit auxiliary light based on lightemission states of the auxiliary light emitting units 13 a and 13 b.

When the synchronization signal is generated, the main control unit 217sets light emission timings of the auxiliary light emitting units 13 aand 13 b such that the auxiliary light emitting units 13 a and 13 b emitauxiliary light at different timings (that is, auxiliary light beams areemitted in a time-division manner).

In addition, the main control unit 217 may also set timings at which theimaging units 15 a and 15 b capture an image. In this case, the maincontrol unit 217 sets the imaging timing of the imaging unit 15 a suchthat the imaging unit 15 a captures an image in synchronization with alight emission timing of the auxiliary light emitting unit 13 a.Similarly, the main control unit 217 sets the imaging timing of theimaging unit 15 b such that the imaging unit 15 b captures an image insynchronization with a light emission timing of the auxiliary lightemitting unit 13 b.

Then, the main control unit 217 supplies a control signal (for example,a control pulse) to the auxiliary light control unit 113 of the imagingdevice 10 a through the transfer path n11 according to the set lightemission timing of the auxiliary light emitting unit 13 a. When thecontrol signal is received, the auxiliary light control unit 113 of theimaging device 10 a controls an operation of the auxiliary lightemitting unit 13 a emitting auxiliary light (in particular, a lightemission timing of the auxiliary light emitting unit 13 a) based on thecontrol signal.

In addition, the main control unit 217 supplies a control signal (forexample, a control pulse) to the imaging control unit 115 of the imagingdevice 10 a through the transfer path n11 according to the set imagingtiming of the imaging unit 15 a. When the control signal is received,the imaging control unit 115 of the imaging device 10 a controls anoperation of the imaging unit 15 a capturing an image (in particular, animaging timing of the imaging unit 15 a).

Similarly, the main control unit 217 supplies a control signal (forexample, a control pulse) to the auxiliary light control unit 113 of theimaging device 10 b through the transfer path n11 according to the setlight emission timing of the auxiliary light emitting unit 13 b. Whenthe control signal is received, the auxiliary light control unit 113 ofthe imaging device 10 b controls an operation of the auxiliary lightemitting unit 13 b emitting auxiliary light (in particular, a lightemission timing of the auxiliary light emitting unit 13 a) based on thecontrol signal.

In addition, the main control unit 217 supplies a control signal (forexample, a control pulse) to the imaging control unit 115 of the imagingdevice 10 b through the transfer path n11 according to the set imagingtiming of the imaging unit 15 b. When the control signal is received,the imaging control unit 115 of the imaging device 10 b controls anoperation of the imaging unit 15 b capturing an image (in particular, animaging timing of the imaging unit 15 b).

According to the configuration described above, the control system 2according to Modified Example 2 performs control such that the auxiliarylight emitting units 13 a and 13 b emit auxiliary light at differenttimings (that is, auxiliary light beams are emitted in a time-divisionmanner). In such a configuration, similarly to the control system 1according to the above-described embodiment, the control system 2according to Modified Example 2 can prevent occurrence of a situation inwhich auxiliary light beams emitted from the auxiliary light emittingunits 13 a and 13 b interfere with each other and suppress an influenceof the interference from being manifested. That is, according to thecontrol system 2 of Modified Example 2, it is possible to implement amore suitable imaging environment even under a situation in whichauxiliary light is emitted from the plurality of auxiliary lightemitting units 13 (that is, light sources).

1.4.3. Modified Example 3: Example of Functional Configuration

Next, a control system 3 according to Modified Example 3 will bedescribed. In the above-described embodiment, for example, the imagingdevice 10 a acquires a light emission state of the auxiliary lightemitting unit 13 b associated with another imaging device 10 b throughcommunication via the transfer path n11 and controls an operation (forexample, a light emission timing) of the auxiliary light emitting unit13 a associated with the imaging device 10 a based on the light emissionstate. On the other hand, in Modified Example 3, the imaging device 10 aacquires a light emission state of the auxiliary light emitting unit 13b that is controlled by the imaging device 10 b using a method differentfrom direct communication with the other imaging device 10 b, andcontrols an operation of the auxiliary light emitting unit 13 aassociated with the imaging device 10 a based on the acquired lightemission state.

Therefore, details of the control system 3 according to Modified Example3 will be described with reference to FIG. 9 with a focus particularlyon a configuration of the imaging device 10. FIG. 9 is a block diagramshowing an example of a functional configuration of the control system 3according to Modified Example 3. Note that, in this description,similarly to the control system 1 according to the above-describedembodiment (refer to FIG. 4), the control system 3 including the imagingdevices 10 a and 10 b will be described. In addition, as shown in FIG.9, in the control system 3 according to Modified Example 3, since theimaging devices 10 a and 10 b have the same configuration, the imagingdevice 10 a will be described in detail, and details of a configurationof the imaging device 10 b will not be described.

As shown in FIG. 9, the imaging device 10 a according to ModifiedExample 3 has the control unit 11 a whose configuration is differentfrom that of the imaging device 10 a according to the above-describedembodiment (refer to FIG. 4). Therefore, in this description, aconfiguration of the control unit 11 a will be described with a focusparticularly on parts different from those of the imaging device 10 aaccording to the above-described embodiment.

The control unit 11 a includes a state acquisition unit 311, a maincontrol unit 317, an auxiliary light control unit 313, an imagingcontrol unit 315, and an analysis unit 319.

The auxiliary light control unit 313 corresponds to the auxiliary lightcontrol unit 113 of the imaging device 10 a according to theabove-described embodiment (refer to FIG. 4). That is, the auxiliarylight control unit 313 controls an operation of the auxiliary lightemitting unit 13 a emitting auxiliary light based on a control signalsupplied from the main control unit 317 to be described below.

The imaging control unit 315 corresponds to the imaging control unit 115of the imaging device 10 a according to the above-described embodiment(refer to FIG. 4). That is, the imaging control unit 315 controls anoperation of the imaging unit 15 a capturing an image based on a controlsignal supplied from the main control unit 317 to be described below.

In addition, the imaging control unit 315 according to Modified Example3 causes the imaging unit 15 a to capture an image of the imaging regionr15 a at each of timings that are determined in advance (for example, ata predetermined frame rate), and sequentially outputs the capturedimages to the analysis unit 319 in time series. Also, in this case, theimage captured by the imaging unit 15 a may be a so-called through image(for example, a thinned image).

The analysis unit 319 sequentially acquires the images of the imagingregion r15 a captured by the imaging unit 15 a from the imaging controlunit 315 in time series. The analysis unit 319 performs image analysison the images acquired in time series and thus calculates a luminancedistribution of the images.

Then, the analysis unit 319 sequentially outputs information indicatingthe calculated luminance distribution of the images to the stateacquisition unit 311 in time series.

The state acquisition unit 311 sequentially acquires informationindicating luminance distributions of a series of images of the imagingregion r15 a captured by the imaging unit 15 a from the analysis unit319 in time series. Then, the state acquisition unit 311 estimates alight emission state of the auxiliary light emitting unit 13 b ofanother imaging device 10 b that emits auxiliary light toward theimaging region r15 a based on the information indicating luminancedistributions of the images acquired in time series.

Specifically, when the auxiliary light emitting unit 13 b of the imagingdevice 10 b emits auxiliary light toward the imaging region r15 a of theimaging unit 15 a, brightness of the imaging region r15 a changesaccording to emission of the auxiliary light. Therefore, a change inbrightness of the imaging region r15 a is manifested as a change in theluminance distribution of the image captured by the imaging unit 15 a.The state acquisition unit 311 according to Modified Example 3 uses sucha characteristic and estimates a light emission state of anotherauxiliary light emitting unit 13 b that emits auxiliary light toward theimaging region r15 a.

Also, brightness of the imaging region r15 a may be changed by auxiliarylight emitted from the auxiliary light emitting unit 13 a. In such acase, the state acquisition unit 311 acquires information indicatingcontrol content (for example, a light emission timing and an amount oflight emission) of the auxiliary light emitting unit 13 a from theauxiliary light control unit 113 of the imaging device 10 a, and thusestimates a change in brightness of the imaging region r15 a accordingto auxiliary light emitted from the auxiliary light emitting unit 13 a.Then, the state acquisition unit 311 compares information indicating theluminance distribution of the images acquired in time series from theanalysis unit 319 with the estimation result of a change in brightnessof the imaging region r15 a according to auxiliary light emitted fromthe auxiliary light emitting unit 13 a, and thus may estimate a lightemission state of the auxiliary light emitting unit 13 b.

As described above, the state acquisition unit 311 estimates a lightemission state of another auxiliary light emitting unit 13 b that emitsauxiliary light toward the imaging region r15 a and outputs theestimation result to the main control unit 317.

The main control unit 317 acquires the estimation result of the lightemission state of the other auxiliary light emitting unit 13 b thatemits auxiliary light toward the imaging region r15 a from the stateacquisition unit 311. Then, the main control unit 317 sets a lightemission timing of the auxiliary light emitting unit 13 a based on theacquired estimation result of the light emission state of the otherauxiliary light emitting unit 13 b. Specifically, based on theestimation result of the light emission state of the auxiliary lightemitting unit 13 b, the main control unit 317 sets a light emissiontiming of the auxiliary light emitting unit 13 a such that the auxiliarylight emitting units 13 a and 13 b emit auxiliary light at differenttimings (that is, auxiliary light beams are emitted in a time-divisionmanner).

In addition, the main control unit 317 may also set timings at which theimaging units 15 a capture an image. In this case, the main control unit317 sets the imaging timing of the imaging unit 15 a such that theimaging unit 15 a captures an image in synchronization with a lightemission timing of the auxiliary light emitting unit 13 a.

Note that the following operations are similar to those when the imagingdevice 10 a according to the above-described embodiment (refer to FIG.4) controls operations of the auxiliary light emitting unit 13 a and theimaging unit 15 a. That is, the main control unit 317 supplies a controlsignal (for example, a control pulse) to an auxiliary light control unit413 according to the set light emission timing of the auxiliary lightemitting unit 13 a. The auxiliary light control unit 313 controls anoperation of the auxiliary light emitting unit 13 a emitting auxiliarylight based on the control signal supplied from the main control unit317.

In addition, the main control unit 317 supplies a control signal (forexample, a control pulse) to the imaging control unit 315 according tothe set imaging timing of the imaging unit 15 a. The imaging controlunit 315 controls an operation of the imaging unit 15 a capturing animage based on the control signal supplied from the main control unit317.

As described above, when operations of the auxiliary light emitting unit13 a and the imaging unit 15 a are controlled based on the controlsignal from the main control unit 317, a light emission timing of theauxiliary light emitting unit 13 a and an imaging timing of the imagingunit 15 a are synchronized.

In addition, the imaging device 10 a controls an operation of theauxiliary light emitting unit 13 a such that the auxiliary lightemitting unit 13 a emits auxiliary light at a timing different from thatof another auxiliary light emitting unit 13 b that emits auxiliary lighttoward the imaging region r15 a of the imaging unit 15 a (that is,auxiliary light beams are emitted in a time-division manner).

According to the above-described configuration, similarly to the controlsystem 1 according to the above-described embodiment, the control system3 according to Modified Example 3 can prevent occurrence of a situationin which auxiliary light beams emitted from the auxiliary light emittingunits 13 a and 13 b interfere with each other and suppress an influenceof the interference from being manifested. That is, according to thecontrol system 3 of Modified Example 3, it is possible to implement amore suitable imaging environment even under a situation in whichauxiliary light is emitted from the plurality of auxiliary lightemitting units 13 (that is, light sources).

In addition, in the control system 3 according to Modified Example 3,each of the imaging devices 10 sequentially monitors a change inbrightness of an imaging region of the imaging unit 15 that iscontrolled by the imaging device 10 itself based on the image capturedby the imaging unit 15 and controls an operation of the auxiliary lightemitting unit 13 that is controlled by the imaging device 10 itselfaccording to the monitoring result. Therefore, in the control system 3according to Modified Example 3, even under a situation in whichauxiliary light is emitted from a device outside the control system 3 toimaging regions of the imaging units 15 of the imaging devices 10, it ispossible to prevent occurrence of a situation in which a plurality ofauxiliary light beams interfere with each other and it is possible toimplement a more suitable imaging environment.

1.4.4. Modified Example 4: Example of Functional Configuration

Next, a control system 4 according to Modified Example 4 will bedescribed. In the above-described Modified Example 3, each of theimaging devices 10 acquires a light emission state of another auxiliarylight emitting unit 13 that emits auxiliary light toward an imagingregion of the imaging unit 15 based on the image captured by the imagingunit 15 whose operation is controlled by the imaging device 10 itself.On the other hand, as long as each of the imaging devices 10 can acquirea light emission state of another auxiliary light emitting unit 13 thatemits auxiliary light toward an imaging region of the imaging unit 15whose operation is controlled by the imaging device 10 itself, a methodand configuration thereof are not particularly limited. Therefore, inModified Example 4, another example of the control system in which eachof the imaging devices 10 uses a method different from directcommunication with another imaging device 10 and can acquire a lightemission state of the auxiliary light emitting unit 13 that iscontrolled by the other imaging device 10 will be described.

The imaging device 10 according to Modified Example 4 emits auxiliarylight of a specific light emission pattern to the auxiliary lightemitting unit 13 whose operation is controlled by the imaging device 10itself, and thus notifies the other imaging device 10 of the lightemission state of the auxiliary light emitting unit 13 according to thelight emission pattern. Therefore, an example of a functionalconfiguration of the control system 4 according to Modified Example 4will be described below with reference to FIG. 10 with a focusparticularly on a configuration of the imaging device 10. FIG. 10 is ablock diagram showing an example of a functional configuration of thecontrol system 4 according to Modified Example 4.

Note that, in this description, similarly to the control system 1according to the above-described embodiment (refer to FIG. 4), thecontrol system 4 including the imaging devices 10 a and 10 b will bedescribed. In addition, as shown in FIG. 10, in the control system 4according to Modified Example 4, since the imaging devices 10 a and 10 bhave the same configuration, the imaging device 10 a will be describedin detail, and details of a configuration of the imaging device 10 bwill not be described.

As shown in FIG. 10, the imaging device 10 a according to ModifiedExample 4 includes the control unit 11 a, the auxiliary light emittingunit 13 a, the imaging unit 15 a, and a light detecting unit 17 a. Inaddition, the control unit 11 a according to Modified Example 4 includesa state acquisition unit 411, a main control unit 417, the auxiliarylight control unit 413, an imaging control unit 415, and an analysisunit 419. Note that, since the auxiliary light emitting unit 13 a andthe imaging unit 15 a are similar to those of the imaging device 10 aaccording to the above-described embodiment (refer to FIG. 4), detaileddescriptions thereof will be omitted. Note that, when the lightdetecting unit 17 a of the imaging device 10 a and the light detectingunit 17 of the imaging device 10 b are not particularly distinguished,they will be simply referred to as a “light detecting unit 17” below insome cases.

The auxiliary light control unit 413 corresponds to the auxiliary lightcontrol unit 113 of the imaging device 10 a according to theabove-described embodiment (refer to FIG. 4). That is, the auxiliarylight control unit 413 controls an operation of the auxiliary lightemitting unit 13 a emitting auxiliary light based on a control signalsupplied from the main control unit 417 to be described below.

The imaging control unit 415 corresponds to the imaging control unit 115of the imaging device 10 a according to the above-described embodiment(refer to FIG. 4). That is, the imaging control unit 415 controls anoperation of the imaging unit 15 a capturing an image based on a controlsignal supplied from the main control unit 417 to be described below.

Note that, in the following description, in order to more easilyunderstand characteristics of configurations of the imaging device 10 a,description will focus separately particularly on a configuration for anoperation of “notification of a light emission state” and aconfiguration for an operation of “acquisition of a light emissionstate.”

(Notification of Light Emission State)

First, a configuration of the imaging device 10 a will be described witha focus on an operation in which the imaging device 10 a notifiesanother imaging device 10 b of a light emission state of the auxiliarylight emitting unit 13 a that is controlled by the imaging device 10 aitself.

The auxiliary light control unit 413 of the imaging device 10 aaccording to Modified Example 4 causes the auxiliary light emitting unit13 a to emit auxiliary light of a light emission pattern according to alight emission state of the auxiliary light emitting unit 13 a at apredetermined timing (that is, light or a blinking), and thus notifiesanother imaging device 10 b of the light emission state of the auxiliarylight emitting unit 13 a.

Also, specific content of which the auxiliary light control unit 413 ofthe imaging device 10 a notifies another imaging device 10 b as a lightemission state of the auxiliary light emitting unit 13 a using a lightemission pattern of auxiliary light is similar to that of the controlsystem 1 according to the above-described embodiment (refer to FIG. 4).

Specifically, the auxiliary light control unit 413 of the imaging device10 a may notify another imaging device 10 b of control parameters forthe auxiliary light emitting unit 13 a to emit auxiliary light (forexample, a light emission interval of auxiliary light) using a lightemission pattern of auxiliary light. In addition, as another example,the auxiliary light control unit 413 of the imaging device 10 a maynotify another imaging device 10 b of identification information forspecifying a light emission state of the auxiliary light emitting unit13 a using a light emission pattern of auxiliary light.

Also, a timing at which the auxiliary light control unit 413 of theimaging device 10 a notifies another imaging device 10 b of a lightemission state of the auxiliary light emitting unit 13 a using a lightemission pattern of auxiliary light is not particularly limited. As aspecific example, the auxiliary light control unit 413 causes theauxiliary light emitting unit 13 a to emit auxiliary light of a specificlight emission pattern at a timing at which the imaging device 10 astarts, and thus may notify another imaging device 10 b of a lightemission state of the auxiliary light emitting unit 13 a.

(Acquisition of Light Emission State)

Next, a configuration of the imaging device 10 a will be described witha focus on an operation in which the imaging device 10 a acquires alight emission state of the auxiliary light emitting unit 13 b based onauxiliary light that is emitted from the auxiliary light emitting unit13 b of another imaging device 10 b.

The light detecting unit 17 a includes a so-called sensor that detects achange in an intensity (for example, luminance) of received light and achange in ambient brightness. Here, the light detecting unit 17 aconfigured to detect a change in ambient brightness (that is, a changein brightness of a predetermined detection area) will be described.

The light detecting unit 17 a detects a change in brightness of thedetection area and sequentially outputs the detection results to theanalysis unit 419. In this case, when the auxiliary light emitting unit13 b emits auxiliary light toward the detection area of the lightdetecting unit 17 a, the light detecting unit 17 a detects a change inbrightness according to emission of the auxiliary light.

The analysis unit 419 sequentially acquires the detection results fromthe light detecting unit 17 a, analyzes the acquired detection results,and thus determines whether auxiliary light emitted from the auxiliarylight emitting unit 13 b of another imaging device 10 b is detected.

As a specific example, the analysis unit 419 acquires informationindicating control content (for example, a light emission timing and anamount of light emission) of the auxiliary light emitting unit 13 a fromthe auxiliary light control unit 413 of the imaging device 10 a, andthus may estimate a change in ambient brightness according to auxiliarylight emitted from the auxiliary light emitting unit 13 a.

That is, the analysis unit 419 compares the detection result acquiredfrom the light detecting unit 17 a with the estimation result of achange in ambient brightness according to auxiliary light emitted fromthe auxiliary light emitting unit 13 a, and thus determines whetherauxiliary light emitted from the auxiliary light emitting unit 13 b isemitted. Then, when the comparison result is that they are different,the analysis unit 419 acquires a detection result of auxiliary lightemitted from the auxiliary light emitting unit 13 b based on adifference between the estimation result of a change in ambientbrightness according to auxiliary light emitted from the auxiliary lightemitting unit 13 a and the detection result acquired from the lightdetecting unit 17 a.

Also, the imaging device 10 a is operated with another imaging device 10c, which is linked already, other than the imaging device 10 b in somecases. In this case, the analysis unit 419 may estimate a change inambient brightness according to the auxiliary light emitting unit 13 cassociated with the imaging device 10 c based on information of theauxiliary light emitting unit 13 c that has already been acquired when alink is established. Specifically, the analysis unit 419 may recognize atiming at which the auxiliary light emitting unit 13 c emits auxiliarylight based on a control result of the main control unit 117. Inaddition, the analysis unit 419 may recognize settings for the auxiliarylight emitting unit 13 c to emit auxiliary light (for example, a lightemission interval and an amount of light emission) based on a lightemission state of the auxiliary light emitting unit 13 c that hasalready been acquired when a link is established.

As described above, when a detection result of auxiliary light emittedfrom the auxiliary light emitting unit 13 b is acquired, the analysisunit 419 analyzes the detection result and thus specifies the lightemission pattern of auxiliary light. Then, the analysis unit 419 outputsinformation indicating the specified light emission pattern of auxiliarylight to the state acquisition unit 411.

The state acquisition unit 411 acquires information indicating a lightemission pattern of auxiliary light from the analysis unit 419 andacquires a light emission state of the auxiliary light emitting unit 13b of the imaging device 10 b based on the acquired informationindicating a light emission pattern.

Specifically, data in which information indicating a light emissionpattern of auxiliary light and specific information indicating a lightemission state of the auxiliary light emitting unit 13 are associatedmay be stored in advance in a position which is readable by the stateacquisition unit 411. Then, the state acquisition unit 411 checks theinformation indicating a light emission pattern of auxiliary lightacquired from the analysis unit 419 and the data and thus may acquire alight emission state of the auxiliary light emitting unit 13 b of theimaging device 10 b.

As described above, the state acquisition unit 411 acquires a lightemission state of the auxiliary light emitting unit 13 b of the imagingdevice 10 b, and outputs the acquired light emission state of theauxiliary light emitting unit 13 b to the main control unit 417.

The main control unit 417 acquires the light emission state of theauxiliary light emitting unit 13 b of the imaging device 10 b from thestate acquisition unit 411. Then, the main control unit 417 sets a lightemission timing of the auxiliary light emitting unit 13 a based on theacquired light emission state of the auxiliary light emitting unit 13 b.Specifically, based on the light emission state of the auxiliary lightemitting unit 13 b, the main control unit 417 sets a light emissiontiming of the auxiliary light emitting unit 13 a such that the auxiliarylight emitting units 13 a and 13 b emit auxiliary light at differenttimings (that is, auxiliary light beams are emitted in a time-divisionmanner).

In addition, the main control unit 417 may also set timings at which theimaging units 15 a capture an image. In this case, the main control unit417 sets an imaging timing of the imaging unit 15 a such that theimaging unit 15 a captures an image in synchronization with a lightemission timing of the auxiliary light emitting unit 13 a.

Note that the following operations are similar to those when the imagingdevice 10 a according to the above-described embodiment (refer to FIG.4) controls operations of the auxiliary light emitting unit 13 a and theimaging unit 15 a. That is, the main control unit 417 supplies a controlsignal (for example, a control pulse) to the auxiliary light controlunit 413 according to the set light emission timing of the auxiliarylight emitting unit 13 a. The auxiliary light control unit 413 controlsan operation of the auxiliary light emitting unit 13 a emittingauxiliary light based on the control signal supplied from the maincontrol unit 417.

In addition, the main control unit 417 supplies a control signal (forexample, a control pulse) to the imaging control unit 415 according tothe set imaging timing of the imaging unit 15 a. The imaging controlunit 415 controls an operation of the imaging unit 15 a capturing animage based on the control signal supplied from the main control unit417.

As described above, when operations of the auxiliary light emitting unit13 a and the imaging unit 15 a are controlled based on the controlsignal from the main control unit 417, a light emission timing of theauxiliary light emitting unit 13 a and an imaging timing of the imagingunit 15 a are synchronized.

In addition, the imaging device 10 a controls an operation of theauxiliary light emitting unit 13 a such that the auxiliary lightemitting unit 13 a emits auxiliary light at a timing different from thatof the auxiliary light emitting unit 13 b of the imaging device 10 b(that is, auxiliary light beams are emitted in a time-division manner).

According to the above-described configuration, similarly to the controlsystem 1 according to the above-described embodiment, the control system4 according to Modified Example 4 can prevent occurrence of a situationin which auxiliary light beams emitted from the auxiliary light emittingunits 13 a and 13 b interfere with each other and suppress an influenceof the interference from being manifested. That is, according to thecontrol system 4 of Modified Example 4, it is possible to implement amore suitable imaging environment even under a situation in whichauxiliary light is emitted from the plurality of auxiliary lightemitting units 13 (that is, light sources).

In addition, in the control system 4 according to Modified Example 4,each of the imaging devices 10 sequentially monitors a change in ambientbrightness (that is, a change in brightness of a detection area of thelight detecting unit 17) based on a detection result of the lightdetecting unit 17 and controls an operation of the auxiliary lightemitting unit 13 that is controlled by the imaging device 10 itselfaccording to the monitoring result. Therefore, in the control system 4according to Modified Example 4, even under a situation in which adevice outside the control system 3 emits auxiliary light toward imagingregions of the imaging units 15 of the imaging devices 10, it ispossible to prevent occurrence of a situation in which a plurality ofauxiliary light beams interfere with each other and it is possible toimplement a more suitable imaging environment.

1.5. Summary

As described above, the control system 1 according to the embodimentperforms control such that the auxiliary light emitting units 13 of theplurality of imaging devices 10 emit auxiliary light at differenttimings (that is, auxiliary light beams are emitted in a time-divisionmanner). In such a configuration, the control system 1 according to theembodiment can prevent occurrence of a situation in which auxiliarylight beams emitted from the auxiliary light emitting units 13 of theplurality of imaging devices 10 interfere with each other and suppressan influence of the interference from being manifested. That is,according to the control system 1 of the embodiment, it is possible toimplement a more suitable imaging environment even under a situation inwhich auxiliary light is emitted from the plurality of auxiliary lightemitting units 13 (that is, light sources).

2. Second Embodiment 2.1. Overview

Next, a control system according to a second embodiment of the presentdisclosure will be described. The control system 1 according to theabove-described first embodiment performs control such that theauxiliary light emitting units 13 of the plurality of imaging devices 10emit auxiliary light at different timings (that is, auxiliary lightbeams are emitted in a time-division manner), and thus a more suitableimaging environment is implemented. On the other hand, when theauxiliary light emitting units 13 emit auxiliary light in atime-division manner, a period during which each of the auxiliary lightemitting units 13 emits auxiliary light decreases as a multiplicity oftime division increases (that is, as the number of auxiliary lightemitting units 13 increases), and the multiplicity also has alimitation.

Therefore, a control system according to the embodiment controls a lightintensity of auxiliary light emitted from each of the auxiliary lightemitting units 13 according to a light emission state of each of theauxiliary light emitting units 13, and thus a more suitable imagingenvironment is implemented. In addition, in order to distinguish acontrol system according to the embodiment from the control systemaccording to the above-described first embodiment, it will be describedas a “control system 5” below in some cases.

For example, FIG. 11 is an explanatory diagram for describing schematicoperations of the control system 5 according to the embodiment. FIG. 11shows an example of a schematic timing chart showing timings at whichthe auxiliary light emitting units 13 a and 13 b emit auxiliary lightand timings at which the imaging units 15 a and 15 b capture an image,and a lateral direction corresponds to a time axis. Note that, in FIG.11, in order to more easily understand characteristics of the controlsystem 5 according to the embodiment, a light intensity of auxiliarylight emitted from the auxiliary light emitting unit 13 is schematicallyindicated by a height of a control pulse for controlling an operation ofeach of the auxiliary light emitting units 13.

In addition, in this description, the imaging devices 10 a and 10 b thatare operated in the operation environment shown in FIG. 2 will bedescribed. That is, as shown in FIG. 2, the region r13 b illuminatedwith auxiliary light emitted from the auxiliary light emitting unit 13 boverlaps the imaging region r15 a of the imaging unit 15 a.

In FIG. 11, a reference sign I_(a1) schematically indicates a lightintensity of auxiliary light emitted from the auxiliary light emittingunit 13 a when only auxiliary light from the auxiliary light emittingunit 13 a is emitted toward the imaging region r15 a of the imaging unit15 a (that is, when the imaging device 10 a alone is operated). On theother hand, a reference sign I_(a2) schematically indicates a lightintensity of auxiliary light emitted from the auxiliary light emittingunit 13 a when auxiliary light from the auxiliary light emitting unit 13b is emitted toward the imaging region r15 a of the imaging unit 15 a(that is, when the imaging devices 10 a and 10 b are operated in linkageas shown in FIG. 2).

Similarly, a reference sign I_(b1) schematically indicates a lightintensity of auxiliary light emitted from the auxiliary light emittingunit 13 b when only auxiliary light from the auxiliary light emittingunit 13 b is emitted toward the imaging region r15 b of the imaging unit15 b (that is, when the imaging device 10 b alone is operated). On theother hand, a reference sign I_(b2) schematically indicates a lightintensity of auxiliary light emitted from the auxiliary light emittingunit 13 b when auxiliary light from the auxiliary light emitting unit 13a is emitted toward the imaging region r15 b of the imaging unit 15 b(that is, when the imaging devices 10 a and 10 b are operated in linkageas shown in FIG. 2).

As shown in FIG. 2, when the auxiliary light emitting unit 13 b emitsauxiliary light toward the imaging region r15 a of the imaging unit 15 aalong with the auxiliary light emitting unit 13 a, the imaging regionr15 a becomes brighter according to a light intensity of auxiliary lightemitted from the auxiliary light emitting unit 13 b.

Therefore, as shown in FIG. 11, when auxiliary light is emitted from theplurality of auxiliary light emitting units 13 toward the imaging regionr15 a of the imaging unit 15 a, the control system 5 according to theembodiment limits a light intensity of auxiliary light of each of theauxiliary light emitting units 13 and controls brightness of the imagingregion r15 a. In this case, for example, the imaging device 10 aacquires a light emission state of the auxiliary light emitting unit 13b (for example, an amount of light emission) that is controlled byanother imaging device 10 b, and limits a light intensity of auxiliarylight of the auxiliary light emitting unit 13 a that is controlled bythe imaging device 10 a itself according to the acquired light emissionstate of the auxiliary light emitting unit 13 b.

For example, when light intensities of auxiliary light beams emittedfrom the auxiliary light emitting units 13 a and 13 b are the same andthe auxiliary light emitting units 13 a and 13 b emit auxiliary light tosubstantially the same region, brightness of the region is simplydoubled. In this case, when a light intensity of auxiliary light emittedfrom each of the auxiliary light emitting units 13 a and 13 b is reducedto half, brightness of the region is controlled such that it issubstantially in a state in which, for example, only the auxiliary lightemitting unit 13 a emits auxiliary light.

It should be noted that regions toward which the auxiliary lightemitting units 13 a and 13 b emit auxiliary light do not necessarilycompletely match. Therefore, the control system 5 determines a degree ofinterference between auxiliary light beams emitted from the auxiliarylight emitting units 13 a and 13 b based on a positional relationbetween the auxiliary light emitting units 13 a and 10 b, and maycontrol a light intensity of each auxiliary light beam according to thedetermination result.

In this manner, when auxiliary light beams from the plurality ofauxiliary light emitting units 13 interfere with each other, the controlsystem 5 according to the embodiment limits a light intensity of eachauxiliary light beam according to a degree of interference and thuscontrols a target region (that is, an imaging region of each of theimaging units 15) to have more suitable brightness. In such aconfiguration, the control system 5 according to the embodiment canimplement a more suitable imaging environment without emitting auxiliarylight in a time-division manner.

In addition, in the control system 5 according to the embodiment, sinceit is not necessary to emit auxiliary light beams in a time-divisionmanner, there is no influence from a limitation of multiplicityaccording to a time-division manner, and it is possible to link moreauxiliary light emitting units 13 than in the control system 1 accordingto the above-described first embodiment. In addition, when the controlsystem 5 according to the embodiment limits a light intensity ofauxiliary light emitted from each of the auxiliary light emitting units13, it is possible to implement a more suitable imaging environment andrestrict power consumption to a lower amount.

The overview of the control system 5 according to the embodiment hasbeen described above with reference to FIG. 11. Hereinafter, the controlsystem 5 according to the embodiment will be described in furtherdetail.

2.2. Functional Configuration

An example of a functional configuration of the control system 5according to the embodiment will be described with reference to FIG. 12.FIG. 12 is a block diagram showing an example of a functionalconfiguration of the control system 5 according to the embodiment.

Note that, as shown in FIG. 12, the functional configuration of thecontrol system 5 according to the embodiment is similar to that of thecontrol system 1 according to the above-described first embodiment(refer to FIG. 4). For this reason, in this description, a functionalconfiguration of the control system 5 according to the embodiment willbe described with a focus particularly on parts different from those ofthe control system 1 according to the above-described first embodiment.

As shown in FIG. 12, the imaging device 10 a according to the embodimentincludes a control unit 51 a, the auxiliary light emitting unit 13 a,the imaging unit 15 a, and the communication unit 19. Also, since theauxiliary light emitting unit 13 a, the imaging unit 15 a, and thecommunication unit 19 shown in FIG. 12 are similar to the auxiliarylight emitting unit 13 a, the imaging unit 15 a, and the communicationunit 19 in the imaging device 10 a according to the first embodimentshown in FIG. 4, detailed descriptions thereof will be omitted.

The control unit 51 a is a component for controlling operations of theauxiliary light emitting unit 13 a and the imaging unit 15 a, andcorresponds to the control unit 11 a in the imaging device 10 aaccording to the first embodiment shown in FIG. 4. Also, the controlunit 51 a will be separately described below in detail.

Similarly, the imaging device 10 b according to the embodiment includesa control unit 51 b, the auxiliary light emitting unit 13 b, the imagingunit 15 b, and the communication unit 19. Also, since the auxiliarylight emitting unit 13 b, the imaging unit 15 b, and the communicationunit 19 shown in FIG. 12 are similar to the auxiliary light emittingunit 13 b, the imaging unit 15 b, and the communication unit 19 in theimaging device 10 b according to the first embodiment shown in FIG. 4,detailed descriptions thereof will be omitted.

The control unit 51 b is a component for controlling operations of theauxiliary light emitting unit 13 b and the imaging unit 15 b andcorresponds to the control unit 11 b in the imaging device 10 baccording to the first embodiment shown in FIG. 4. Note that the controlunit 51 b will be separately described below in detail. In addition,when the control units 51 a and 31 b are not particularly distinguished,they will be simply referred to as a “control unit 51” below in somecases.

Also, in the control system 5 according to the embodiment, among theplurality of imaging devices 10 (for example, the imaging devices 10 aand 10 b), any of the imaging devices 10 is operated as a master and theother imaging device 10 other than the master is operated as a slave.Therefore, between the imaging devices 10 a and 10 b shown in FIG. 12,the imaging device 10 a will be operated as a master and the imagingdevice 10 b will be operated as a slave below, and details ofconfigurations of the imaging devices 10 will be described with a focusparticularly on a configuration of the control unit 51.

(Master)

First, details of a configuration of the imaging device 10 a operated asa master will be described with a focus particularly on a configurationof the control unit 51 a. As shown in FIG. 12, the control unit 51 aaccording to the embodiment includes a state acquisition unit 511, anauxiliary light control unit 513, an imaging control unit 515, and amain control unit 517.

The state acquisition unit 511 of the imaging device 10 a acquirescontrol parameters for the auxiliary light emitting unit 13 a to emitauxiliary light from a predetermined acquisition source. Note that thecontrol parameters include setting information of, for example, a lightemission interval (for example, a frame rate) of auxiliary light that isemitted from the auxiliary light emitting unit 13 a, a range withinwhich the light emission interval is controllable, a light intensity ofauxiliary light, and a frequency of light that is emitted as auxiliarylight. In the control system 5 according to the embodiment, the stateacquisition unit 511 acquires at least a control parameter indicating alight intensity (or a range within which a light intensity of theauxiliary light is controllable) of auxiliary light that is emitted fromthe auxiliary light emitting unit 13 a. In addition, the stateacquisition unit 511 may acquire a control parameter indicating a lightemission interval (or a range within which the light emission intervalis controllable) of auxiliary light that is emitted from the auxiliarylight emitting unit 13 a.

In addition, as long as the state acquisition unit 511 of the imagingdevice 10 a can acquire control parameters for the auxiliary lightemitting unit 13 a to emit auxiliary light, an acquisition source of thecontrol parameters is not particularly limited. This is similar to theimaging device 10 a according to the above-described first embodiment.

In addition, the state acquisition unit 511 of the imaging device 10 aacquires control parameters for the auxiliary light emitting unit 13 bto emit auxiliary light from the imaging device 10 b through thetransfer path n11. In this case, the state acquisition unit 511instructs the imaging device 10 b to transmit control parameters andthus may actively acquire the control parameters from the imaging device10 b. Also, as another example, the state acquisition unit 511 may awaittransmission of control parameters from the imaging device 10 b and thusmay passively acquire the control parameters from the imaging device 10b.

Note that, in this case, the state acquisition unit 511 of the imagingdevice 10 a confirms an operation state of the imaging device 10 bserving as a link target based on communication through the transferpath n11, and only when the imaging device 10 b is operated, may acquirecontrol parameters from the imaging device 10 b.

As described above, the state acquisition unit 511 of the imaging device10 a acquires light emission states of the auxiliary light emittingunits 13 a and 13 b (for example, amounts of light emission of theauxiliary light emitting units 13 a and 13 b) and outputs the acquiredlight emission states of the auxiliary light emitting units 13 a and 13b to the main control unit 517.

The main control unit 517 acquires light emission states of theauxiliary light emitting units 13 a and 13 b (for example, amounts oflight emission of the auxiliary light emitting units 13 a and 13 b) fromthe state acquisition unit 511.

In addition, the main control unit 517 generates a synchronizationsignal for connecting timings at which the auxiliary light emittingunits 13 a and 13 b emit auxiliary light. In this case, when controlparameters indicating light emission intervals of auxiliary light beamsthat are emitted from the auxiliary light emitting units 13 a and 13 bare acquired as light emission states of the auxiliary light emittingunits 13 a and 13 b, the main control unit 517 may generate asynchronization signal based on the control parameters. For example,FIG. 12 shows an example of the synchronization signal that is generatedby the main control unit 517.

When the synchronization signal is generated, the main control unit 517sets light emission timings of the auxiliary light emitting units 13 aand 13 b such that the auxiliary light emitting units 13 a and 13 b emitauxiliary light in synchronization with each other.

In addition, the main control unit 517 sets light intensities ofauxiliary light beams emitted from the auxiliary light emitting units 13a and 13 b based on the acquired light emission states of the auxiliarylight emitting units 13 a and 13 b (for example, amounts of lightemission of the auxiliary light emitting units 13 a and 13 b). As aspecific example, the main control unit 517 may set a light intensity ofthe auxiliary light such that a light intensity of auxiliary light thatis emitted from each of the auxiliary light emitting units 13 is limitedaccording to the number of auxiliary light emitting units 13 that emitauxiliary light in linkage.

In addition, in this case, when the main control unit 517 limits a lightintensity of auxiliary light that is emitted from the auxiliary lightemitting units 13 a and 13 b, it may assign a weight to a limitationamount between the auxiliary light emitting units 13 a and 13 baccording to the acquired light emission states of the auxiliary lightemitting units 13 a and 13 b. For example, when an amount of lightemission of the auxiliary light emitting unit 13 b is greater than thatof the auxiliary light emitting unit 13 a, the main control unit 517 mayset a light intensity of auxiliary light that is emitted from each ofthe auxiliary light emitting units 13 a and 13 b such that a lightintensity of auxiliary light emitted from the auxiliary light emittingunit 13 b is limited more.

In addition, the main control unit 517 determines a degree ofinterference between auxiliary light beams emitted from the auxiliarylight emitting units 13 a and 10 b based on a positional relationbetween the auxiliary light emitting units 13 a and 10 b, and maycontrol a light intensity of each auxiliary light beam according to thedetermination result. In this case, the main control unit 517 maydetermine a degree of interference between auxiliary light beams emittedfrom the auxiliary light emitting units 13 a and 10 b according toinformation indicating installation positions and orientations of theauxiliary light emitting units 13 a and 10 b (hereinafter referred to as“position information” in some cases) and information indicating aradiation angle.

Also, as long as the main control unit 517 can acquire positioninformation of each of the auxiliary light emitting units 13 andinformation indicating a radiation angle of the auxiliary light emittingunit 13, an acquisition source of each piece of the information is notparticularly limited. As a specific example, position information ofeach of the auxiliary light emitting units 13 and information indicatinga radiation angle of the auxiliary light emitting unit 13 may be storedin advance in a storage region which is readable by the main controlunit 517. In addition, as another example, the main control unit 517 mayacquire position information of each of the auxiliary light emittingunits 13 and information indicating a radiation angle of the auxiliarylight emitting unit 13 as a user input. In addition, as still anotherexample, the main control unit 517 may acquire position information ofeach of the auxiliary light emitting units 13 and information indicatinga radiation angle of the auxiliary light emitting unit 13 from theimaging device 10 that controls operations of the auxiliary lightemitting unit 13.

In addition, the main control unit 517 of the imaging device 10 a mayalso set timings at which the imaging units 15 a and 15 b capture animage. In this case, the main control unit 517 sets an imaging timing ofthe imaging unit 15 a such that the imaging unit 15 a captures an imagein synchronization with a light emission timing of the auxiliary lightemitting unit 13 a. Similarly, the main control unit 517 sets an imagingtiming of the imaging unit 15 b such that the imaging unit 15 b capturesan image in synchronization with a light emission timing of theauxiliary light emitting unit 13 b.

Then, based on the set light intensity of auxiliary light emitted fromthe auxiliary light emitting unit 13 a, the main control unit 517 of theimaging device 10 a causes the auxiliary light control unit 513 to limita light intensity of the auxiliary light. In addition, the main controlunit 517 supplies a control signal (for example, a control pulse) to theauxiliary light control unit 513 according to the set light emissiontiming of the auxiliary light emitting unit 13 a. The auxiliary lightcontrol unit 513 limits a light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 a based on an instruction fromthe main control unit 517, and controls an operation of the auxiliarylight emitting unit 13 a emitting auxiliary light based on the controlsignal supplied from the main control unit 517.

Note that as long as the auxiliary light control unit 513 can limit alight intensity of auxiliary light that is emitted from the auxiliarylight emitting unit 13 a, a method thereof is not particularly limited.As a specific example, the auxiliary light control unit 513 may reduce alight emission time of the auxiliary light emitting unit 13 a, and thusmay limit a light intensity of auxiliary light that is emitted from theauxiliary light emitting unit 13 a. In addition, as another example, theauxiliary light control unit 513 may limit an amount of light emission(for example, a current value of a current that is supplied to a lightsource) of the auxiliary light emitting unit 13 a, and thus may limit alight intensity of auxiliary light that is emitted from the auxiliarylight emitting unit 13 a.

In addition, the main control unit 517 of the imaging device 10 asupplies a control signal (for example, a control pulse) to the imagingcontrol unit 515 according to the set imaging timing of the imaging unit15 a. The imaging control unit 515 controls an operation of the imagingunit 15 a capturing an image based on the control signal supplied fromthe main control unit 517.

As described above, based on control from the main control unit 517, alight intensity of auxiliary light emitted from the auxiliary lightemitting unit 13 a is limited according to a light intensity ofauxiliary light emitted from another auxiliary light emitting unit 13 b.In addition, when operations of the auxiliary light emitting unit 13 aand the imaging unit 15 a are controlled based on the control signalfrom the main control unit 517, a light emission timing of the auxiliarylight emitting unit 13 a and an imaging timing of the imaging unit 15 aare synchronized.

In addition, based on the set light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 b, the main control unit 517of the imaging device 10 a instructs the imaging device 10 b to limit alight intensity of auxiliary light emitted from the auxiliary lightemitting unit 13 b. When the instruction is received, the imaging device10 b limits a light intensity of auxiliary light emitted from theauxiliary light emitting unit 13 b.

In addition, the main control unit 517 notifies the imaging device 10 bof control information indicating the set light emission timing of theauxiliary light emitting unit 13 b and the set imaging timing of theimaging unit 15 b through the transfer path n11. Accordingly, theimaging device 10 b can control a light emission timing of the auxiliarylight emitting unit 13 b and an imaging timing of the imaging unit 15 bbased on the control information.

The details of the configuration of the imaging device 10 a operated asa master have been described with a focus particularly on theconfiguration of the control unit 51 a.

(Slave)

Next, details of a configuration of the imaging device 10 b operated asa slave will be described with a focus particularly on a configurationof the control unit 51 b. As shown in FIG. 4, the control unit 51 baccording to the embodiment includes the state acquisition unit 511, theauxiliary light control unit 513, the imaging control unit 515, and themain control unit 517.

The state acquisition unit 511 of the imaging device 10 b acquirescontrol parameters for the auxiliary light emitting unit 13 b to emitauxiliary light from a predetermined acquisition source. In addition,since details of control parameters and an acquisition source of thecontrol parameters are similar to those of the imaging device 10 adescribed above, details thereof will not be described. In addition, inthe control system 5 according to the embodiment, the state acquisitionunit 311 acquires at least a control parameter indicating a lightintensity (or a range within which the light emission interval iscontrollable) of auxiliary light that is emitted from the auxiliarylight emitting unit 13 b. Also, the state acquisition unit 511 mayacquire a control parameter indicating a light emission interval (or arange within which the light emission interval is controllable) ofauxiliary light that is emitted from the auxiliary light emitting unit13 b.

The state acquisition unit 511 of the imaging device 10 b transmits theacquired control parameters to the imaging device 10 a through thetransfer path n11. Note that, since a form of the state acquisition unit511 according to the embodiment transmitting the control parameters tothe imaging device 10 a through the transfer path n11 is similar to thatof the state acquisition unit 11 i according to the above-describedfirst embodiment (refer to FIG. 4), detailed description thereof will beomitted.

The main control unit 517 of the imaging device 10 b receives aninstruction for limiting a light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 b in response to transmissionof control parameters from the state acquisition unit 511 to the imagingdevice 10 a. Also, in addition to the instruction, the main control unit517 acquires control information indicating a light emission timing ofthe auxiliary light emitting unit 13 b and an imaging timing of theimaging unit 15 b from the imaging device 10 b.

The main control unit 517 of the imaging device 10 b causes theauxiliary light control unit 513 to limit a light intensity of auxiliarylight emitted from the auxiliary light emitting unit 13 b based on theinstruction from the imaging device 10. Note that a method of limiting alight intensity of auxiliary light is similar to that of a case in whicha light intensity of auxiliary light emitted from the above-describedauxiliary light emitting unit 13 a is limited.

In addition, the main control unit 517 of the imaging device 10 brecognizes a light emission timing of the auxiliary light emitting unit13 b based on the acquired control information and supplies a controlsignal (for example, a control pulse) to the auxiliary light controlunit 513 according to the light emission timing. The auxiliary lightcontrol unit 513 controls an operation of the auxiliary light emittingunit 13 b emitting auxiliary light based on the control signal suppliedfrom the main control unit 517.

In addition, the main control unit 517 of the imaging device 10 brecognizes an imaging timing of the imaging unit 15 b based on theacquired control information and supplies a control signal (for example,a control pulse) to the imaging control unit 515 according to theimaging timing. The imaging control unit 515 controls an operation ofthe imaging unit 15 b capturing an image based on the control signalsupplied from the main control unit 517.

As described above, when operations of the auxiliary light emitting unit13 b and the imaging unit 15 b are controlled based on the controlsignal from the main control unit 517, a light emission timing of theauxiliary light emitting unit 13 b and an imaging timing of the imagingunit 15 b are synchronized. In addition, in this case, a light intensityof auxiliary light emitted from the auxiliary light emitting unit 13 bis limited according to a light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 a.

As described above, when auxiliary light beams from the plurality ofauxiliary light emitting units 13 interfere with each other, the controlsystem 5 according to the embodiment limits a light intensity of eachauxiliary light beam according to a degree of interference and thuscontrols a target region (that is, an imaging region of each of theimaging units 15) to have more suitable brightness. In such aconfiguration, the control system 5 according to the embodiment canimplement a more suitable imaging environment without emitting auxiliarylight in a time-division manner.

In addition, in the control system 5 according to the embodiment, sinceit is not necessary to emit auxiliary light beams in a time-divisionmanner, there is no influence from a limitation of multiplicityaccording to a time-division manner and it is possible to link moreauxiliary light emitting units 13 than in the control system 1 accordingto the above-described first embodiment. In addition, when the controlsystem 5 according to the embodiment limits a light intensity ofauxiliary light emitted from each of the auxiliary light emitting units13, it is possible to implement a more suitable imaging environment andrestrict power consumption to a lower amount.

Also, each of the imaging devices 10 may control imaging conditions (inparticular, exposure conditions and ISO sensitivity) for the imagingunit 15 to capture an image that is controlled by the imaging device 10itself in addition to controlling a light intensity of auxiliary lightemitted from the auxiliary light emitting unit 13 that is controlled bythe imaging device 10 itself.

For example, when a light intensity of auxiliary light emitted from theauxiliary light emitting unit 13 is set, each of the imaging devices 10may also set exposure conditions of the imaging unit 15. For example,the imaging device 10 may decrease a shutter speed of the imaging unit15, and thus may further limit a light intensity of auxiliary lightemitted from the auxiliary light emitting unit 13. Similarly, theimaging device 10 may increase a shutter speed of the imaging unit 15and thus may reduce an amount of limitation of a light intensity ofauxiliary light emitted from the auxiliary light emitting unit 13.

In addition, as another example, each of the imaging devices 10 maydetermine a light intensity of auxiliary light emitted from theauxiliary light emitting unit 13 (in other words, a limitation amount ofa light intensity of the auxiliary light) according to exposureconditions of the imaging unit 15. In addition, as still anotherexample, each of the imaging devices 10 may control imaging conditionsfor the imaging unit 15 to capture an image according to the limitedlight intensity of auxiliary light emitted from the auxiliary lightemitting unit 13.

In addition, the system configuration of the control system 5 and thefunctional configuration of each of the imaging devices 10 describedabove are only examples, and the configurations may be appropriatelychanged similarly to the control system 1 according to theabove-described first embodiment.

As a specific example, the control system 5 may have a configuration inwhich the plurality of imaging devices 10 are individually independentlyoperated. In this case, for example, the plurality of imaging devices 10may share light emission states of the auxiliary light emitting units 13and control an operation (for example, an amount of light emission) oftheir own auxiliary light emitting units 13 according to a lightemission state (for example, an amount of light emission) of theauxiliary light emitting unit 13 of a partner.

In addition, similarly to the control system 1 according to theabove-described first embodiment, a method of each of the imagingdevices 10 specifying another imaging device 10 serving as a link targetis not particularly limited. As a specific example, the imaging devices10 may share information, specify another imaging device 10 that emitsauxiliary light toward an imaging region of its own imaging unit 15based on information acquired from the other imaging device 10, andrecognize the specified imaging device 10 as a link target.

In addition, as another example, each of the plurality of imagingdevices 10 may specify another imaging device 10 serving as a linktarget based on a state in which auxiliary light is emitted from each ofthe imaging devices 10 and an image captured by its own imaging unit 15.

Specifically, any (for example, a master) of the plurality of imagingdevices 10 sequentially emits auxiliary light toward the imaging devices10 in a time-division manner, notifies the imaging devices 10 ofinformation of the imaging device 10 that emits the auxiliary light, andcauses the imaging devices 10 to capture an image in synchronizationwith emission of the auxiliary light.

Each of the imaging devices 10 analyzes an image captured by its ownimaging unit 15, and determines whether an imaging region of its ownimaging unit 15 is illuminated according to emission of auxiliary lightfrom another imaging device 10. Then, each of the imaging devices 10identifies the other imaging device 10 that emits auxiliary light basedon information notified of when the imaging region of its own imagingunit 15 is illuminated and may identify the other imaging device 10 as alink target.

In addition, similarly to Modified Example 1 of the above-describedfirst embodiment, the control system 5 may have a configuration in whichthree or more imaging devices 10 are operated. In this case, accordingto light emission states of the auxiliary light emitting units 13 of thethree or more imaging devices 10, a light intensity of auxiliary lightemitted from each of the auxiliary light emitting units 13 may belimited.

In addition, as another example, similarly to Modified Example 2 of theabove-described first embodiment, a configuration in which the controldevice 20 is provided and the control device 20 controls operations ofthe auxiliary light emitting unit 13 and the imaging unit 15 of eachimaging device may be used.

In addition, as still another example, similarly to Modified Example 3of the above-described first embodiment, each of the imaging devices 10may acquire a light emission state of another auxiliary light emittingunit 10 that emits auxiliary light toward an imaging region of theimaging unit 15 based on an image captured by the imaging unit 15 whoseoperation is controlled by the imaging device 10 itself. In this case,the imaging device 10 may estimate a light emission state of the otherauxiliary light emitting unit 10 based on a change in brightness of theimage captured by the imaging unit 15.

In addition, similarly to Modified Example 4 of the above-describedfirst embodiment, a configuration in which each of the imaging devices10 causes the auxiliary light emitting unit 13 whose operation iscontrolled by the imaging device 10 itself to emit auxiliary light of aspecific light emission pattern, and thus notifies another imagingdevice 10 of the light emission state of the auxiliary light emittingunit 13 may be used.

The example of the functional configuration of the control system 5according to the embodiment has been described above with reference toFIG. 12.

2.3. Processes

Next, an example of a flow of a series of processes of the controlsystem 5 according to the embodiment will be described with reference toFIG. 13 and description will focus particularly on operations of theimaging device 10 a operated as a master. FIG. 13 is a flowchart showingan example of a flow of a series of processes of the control system 5according to the embodiment.

(Step S301)

First, the state acquisition unit 511 of the imaging device 10 aconfirms an operation state of the imaging device 10 b serving as a linktarget based on communication through the transfer path n11.

(Step S303)

When the imaging device 10 b serving as a link target is operated, thestate acquisition unit 511 of the imaging device 10 a acquires controlparameters for the auxiliary light emitting unit 13 b to emit auxiliarylight from the imaging device 10 b through the transfer path n11.

Also, in the control system 1 according to the embodiment, the stateacquisition unit 511 acquires at least a control parameter indicating alight intensity (or a range within which a light intensity of theauxiliary light is controllable) of auxiliary light that is emitted fromthe auxiliary light emitting unit 13 b from the imaging device 10 b.

In addition, the state acquisition unit 511 of the imaging device 10 aacquires control parameters for the auxiliary light emitting unit 13 ato emit auxiliary light from a predetermined acquisition source.

As described above, the state acquisition unit 511 of the imaging device10 a acquires light emission states of the auxiliary light emittingunits 13 a and 13 b (for example, amounts of light emission of theauxiliary light emitting units 13 a and 13 b) and outputs the acquiredlight emission states of the auxiliary light emitting units 13 a and 13b to the main control unit 517.

(Step S305)

The main control unit 517 acquires light emission states of theauxiliary light emitting units 13 a and 13 b (for example, amounts oflight emission of the auxiliary light emitting units 13 a and 13 b) fromthe state acquisition unit 511. The main control unit 517 sets lightintensities of auxiliary light beams emitted from the auxiliary lightemitting units 13 a and 13 b based on the acquired light emission statesof the auxiliary light emitting units 13 a and 13 b (for example,amounts of light emission of the auxiliary light emitting units 13 a and13 b).

In addition, the main control unit 517 generates a synchronizationsignal for connecting timings at which the auxiliary light emittingunits 13 a and 13 b emit auxiliary light. In this case, when controlparameters indicating light emission intervals of auxiliary light beamsthat are emitted from the auxiliary light emitting units 13 a and 13 bare acquired as light emission states of the auxiliary light emittingunits 13 a and 13 b, the main control unit 517 may generate asynchronization signal based on the control parameters.

When the synchronization signal is generated, the main control unit 517sets light emission timings of the auxiliary light emitting units 13 aand 13 b such that the auxiliary light emitting units 13 a and 13 b emitauxiliary light in synchronization with each other.

(Step S307)

Then, based on the set light intensity of auxiliary light emitted fromthe auxiliary light emitting unit 13 a, the main control unit 517 of theimaging device 10 a causes the auxiliary light control unit 513 to limita light intensity of the auxiliary light. In addition, the main controlunit 517 supplies a control signal (for example, a control pulse) to theauxiliary light control unit 513 according to the set light emissiontiming of the auxiliary light emitting unit 13 a The auxiliary lightcontrol unit 513 limits a light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 a based on an instruction fromthe main control unit 517, and controls an operation of the auxiliarylight emitting unit 13 a emitting auxiliary light based on the controlsignal supplied from the main control unit 517.

In addition, the main control unit 517 of the imaging device 10 asupplies a control signal (for example, a control pulse) to the imagingcontrol unit 515 according to the set imaging timing of the imaging unit15 a. The imaging control unit 515 controls an operation of the imagingunit 15 a capturing an image based on the control signal supplied fromthe main control unit 517.

In addition, based on the set light intensity of auxiliary light emittedfrom the auxiliary light emitting unit 13 b, the main control unit 517of the imaging device 10 a instructs the imaging device 10 b to limit alight intensity of auxiliary light emitted from the auxiliary lightemitting unit 13 b. When the instruction is received, the imaging device10 b limits a light intensity of auxiliary light emitted from theauxiliary light emitting unit 13 b.

In addition, the main control unit 517 notifies the imaging device 10 bof control information indicating the set light emission timing of theauxiliary light emitting unit 13 b and the set imaging timing of theimaging unit 15 b through the transfer path n11. Accordingly, theimaging device 10 b can control a light emission timing of the auxiliarylight emitting unit 13 b and an imaging timing of the imaging unit 15 bbased on the control information.

The example of a flow of a series of processes of the control system 5according to the embodiment has been described above with reference toFIG. 13 with a focus particularly on operations of the imaging device 10a operated as a master.

2.4. Summary

As described above, when auxiliary light beams from the plurality ofauxiliary light emitting units 13 interfere with each other, the controlsystem 5 according to the embodiment limits a light intensity of eachauxiliary light beam according to a degree of interference and thuscontrols a target region (that is, an imaging region of each of theimaging units 15) to have more suitable brightness. In such aconfiguration, the control system 5 according to the embodiment canimplement a more suitable imaging environment without emitting auxiliarylight in a time-division manner.

In addition, in the control system 5 according to the embodiment, sinceit is not necessary to emit auxiliary light beams in a time-divisionmanner, there is no influence from a limitation of multiplicityaccording to a time-division manner, and it is possible to link moreauxiliary light emitting units 13 than in the control system 1 accordingto the above-described first embodiment. In addition, when the controlsystem 5 according to the embodiment limits a light intensity ofauxiliary light emitted from each of the auxiliary light emitting units13, it is possible to implement a more suitable imaging environment andrestrict power consumption to a lower amount.

Also, the control system 5 according to the embodiment and the controlsystem 1 according to the above-described first embodiment may beconfigured in combination. In this case, in the control system, theplurality of imaging devices 10 may be divided into a plurality ofgroups and managed. Then, the control system may perform control of atime-division manner of light emission timings of the auxiliary lightemitting units 13 in the control system 1 according to theabove-described first embodiment in units of groups. That is, thecontrol system may control operations of the auxiliary light emittingunits 13 for each group such that auxiliary light emitting units 13included in a group emit auxiliary light at different timings fromauxiliary light emitting units 13 included in another group (that is,auxiliary light beams are emitted in a time-division manner).

Also, in this case, the control system may perform control of a lightintensity of auxiliary light that is emitted from the auxiliary lightemitting unit 13 in the control system 5 according to theabove-described second embodiment within each group. That is, thecontrol system may control a light intensity of auxiliary light that isemitted from the auxiliary light emitting unit 13 according to lightemission states of the auxiliary light emitting units 13 included in thegroup for each group.

3. Hardware Configuration

Next, an example of a hardware configuration of the imaging device 10according to the embodiment of the present disclosure will be describedwith reference to FIG. 14. FIG. 14 is a diagram showing an example of ahardware configuration of the imaging device 10 according to theembodiment.

As shown in FIG. 14, the imaging device 10 according to the embodimentincludes a processor 901, a memory 903, a storage 905, a communicationdevice 911, a light source unit 913, an imaging device 915, and a bus917. In addition, the imaging device 10 may include a manipulationdevice 907 and an informing device 909.

The processor 901 may be, for example, a central processing unit (CPU),a graphics processing unit (GPU), a digital signal processor (DSP) or asystem on chip (SoC), and performs various processes of the imagingdevice 10. For example, the processor 901 can be configured by anelectronic circuit for performing various types of computing processing.Note that the configurations of the control unit 11 described above maybe implemented by the processor 901.

The memory 903 includes a random access memory (RAM) and a read onlymemory (ROM), and stores programs and data that will be executed by theprocessor 901. The storage 905 may include a storage medium such as asemiconductor memory or a hard disk.

The manipulation device 907 has a function of generating an input signalfor the user to perform a desired manipulation. The manipulation device907 may include an input unit for the user to input information, forexample, a button or a switch, and an input control circuit configuredto generate an input signal based on an input by the user and supply thesignal to the processor 901.

The informing device 909 is an example of an output device, and may be adevice, for example, a liquid crystal display (LCD) device and anorganic EL (organic light emitting diode (OLED)) display. In this case,the informing device 909 can inform the user of predeterminedinformation by displaying a screen.

In addition, as another example, the informing device 909 may be adevice configured to inform the user of predetermined information usinga light or blinking pattern such as a light emitting diode (LED). Also,the informing device 909 may be a device configured to inform the userof predetermined information by outputting a predetermined acousticsignal such as a speaker.

The communication device 911 is a communication component of the imagingdevice 10 according to an embodiment of the present disclosure, andcommunicates with an external device via a network. The communicationdevice 911 has a wired or wireless communication interface. When thecommunication device 911 is configured as a wireless communicationinterface, the communication device 911 may include a communicationantenna, a radio frequency (RF) circuit, and a baseband processor.

The communication device 911 has a function of performing various typesof signal processing on a signal received from the external device, andcan supply a digital signal generated from a received analog signal tothe processor 901. Note that the above-described communication unit 19may be implemented by the communication device 911.

The light source unit 913 is a unit configured to emit auxiliary lightand has a configuration capable of emitting light (for example, infraredlight) having a wavelength that is determined in advance. The lightsource unit 913 includes, for example, a light emitting diode (LED). Itshould be noted that the light source unit 913 is not necessarilylimited to an LED as long as it can emit light having a wavelength thatis determined in advance. Also, the above-described auxiliary lightemitting unit 13 may be implemented by the light source unit 913.

The imaging device 915 includes an imaging element such as acomplementary metal-oxide semiconductor (CMOS) image sensor and a chargecoupled device (CCD) image sensor that captures a subject and obtainsdigital data of the captured image. That is, the imaging device 915 hasa function of capturing a still image or a moving image through a lensunder control of the processor 901. The imaging device 915 may store thecaptured image in the memory 903 or the storage 905. Also, theabove-described imaging unit 15 may be implemented by the imaging device915.

The bus 917 connects the processor 901, the memory 903, the storage 905,the manipulation device 907, the informing device 909, the communicationdevice 911, the light source unit 913, and the imaging device 915 to oneanother. The bus 917 may include a plurality of types of buses.

In addition, a program allowing hardware such as a processor, a memory,and a storage built into a computer to execute the same functions as thecomponents of the above-described imaging device 10 can be created. Inaddition, a computer readable storage medium in which the program isrecorded may be provided.

4. Summary

The preferred embodiment(s) of the present disclosure has/have beendescribed above with reference to the accompanying drawings, whilst thepresent disclosure is not limited to the above examples. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

Further, the effects described in this specification are merelyillustrative or exemplified effects, and are not limitative. That is,with or in the place of the above effects, the technology according tothe present disclosure may achieve other effects that are clear to thoseskilled in the art based on the description of this specification.

Additionally, the present technology may also be configured as below.

(1)

A control device including:

an acquisition unit configured to acquire a light emission state of afirst light source; and

a control unit configured to control an operation of light emission of asecond light source that is different from the first light sourceaccording to the acquired light emission state of the first lightsource.

(2)

The control device according to (1),

wherein the control unit controls a light emission timing of the secondlight source according to the light emission state of the first lightsource.

(3)

The control device according to (2),

wherein the control unit controls the light emission timing of thesecond light source in a manner that the first light source and thesecond light source emit light in a time-division manner.

(4)

The control device according to (2) or (3),

wherein the control unit controls an imaging timing of an image of animaging unit that is associated in advance with the second light sourcebased on the light emission timing of the second light source.

(5)

The control device according to (1),

wherein the control unit controls a light intensity of light that isemitted from the second light source according to the light emissionstate of the first light source.

(6)

The control device according to (5),

wherein the control unit controls an imaging condition of an imagingunit that is associated in advance with the second light source based ona light intensity of light that is emitted from the second light source.

(7)

The control device according to (5),

wherein the control unit controls a light intensity of light emittedfrom the second light source based on the light emission state of thefirst light source and an imaging condition of an imaging unit that isassociated in advance with the second light source.

(8)

The control device according to (5),

wherein the control unit controls a light intensity of light that isemitted from the second light source and an imaging condition of animaging unit that is associated in advance with the second light sourceaccording to the light emission state of the first light source.

(9)

The control device according to any one of (1) to (8),

wherein the acquisition unit acquires the light emission state of thefirst light source based on a synchronization signal indicating a lightemission timing of each of the first light source and the second lightsource.

(10)

The control device according to any one of (1) to (8),

wherein the acquisition unit acquires a light emission state of thefirst light source based on control information acquired from anexternal device that is connected via a network and controls anoperation of the first light source.

(11)

The control device according to any one of (1) to (8),

wherein the acquisition unit acquires a light emission state of thefirst light source based on a detection result of light that is emittedfrom the first light source.

(12)

The control device according to any one of (1) to (8), including ananalysis unit configured to analyze an image captured by an imaging unitconfigured to image at least a part of a region that is illuminated bythe second light source,

wherein the acquisition unit acquires a light emission state of thefirst light source based on an analysis result of the image captured bythe imaging unit.

(13)

The control device according to any one of (1) to (12),

wherein the acquisition unit acquires the light emission state of thesecond light source and notifies an external device configured tocontrol an operation of the first light source, of the acquired lightemission state of the second light source.

(14)

The control device according to (13),

wherein the acquisition unit notifies a plurality of the externaldevices of the acquired light emission state of the second light source.

(15)

The control device according to any one of (1) to (14),

wherein the acquisition unit acquires the light emission states of aplurality of the second light sources.

(16)

The control device according to any one of (1) to (15), including

the second light source.

(17)

The control device according to any one of (1) to (16), including

an imaging unit that is associated in advance with the second lightsource.

(18)

A control method performed by a processor, the control method including:

acquiring a light emission state of a first light source; and

controlling an operation of light emission of a second light source thatis different from the first light source according to the acquired lightemission state of the first light source.

(19)

A program causing a computer to execute:

acquiring a light emission state of a first light source; andcontrolling an operation of light emission of a second light source thatis different from the first light source according to the acquired lightemission state of the first light source.

REFERENCE SIGNS LIST

-   1 to 5 control system-   10 imaging device-   11 control unit-   111 state acquisition unit-   113 auxiliary light control unit-   115 imaging control unit-   117 main control unit-   311 state acquisition unit-   313 auxiliary light control unit-   315 imaging control unit-   317 main control unit-   319 analysis unit-   411 state acquisition unit-   413 auxiliary light control unit-   415 imaging control unit-   417 main control unit-   419 analysis unit-   13 auxiliary light emitting unit-   imaging unit-   17 light detecting unit-   19 communication unit-   20 control device-   21 control unit-   211 state acquisition unit-   217 main control unit-   29 communication unit-   30 imaging device-   33 auxiliary light control unit-   35 imaging control unit-   51 control unit-   511 state acquisition unit-   513 auxiliary light control unit-   515 imaging control unit-   517 main control unit

1. A system comprising: a first device comprising: a first image sensor;a first light source that emits infrared light; a first control unit;and a first communication unit; and a second device comprising: a secondimage sensor; a second light source that emits infrared light; a secondcontrol unit; and a second communication unit, wherein the first imagesensor detects the infrared light emitted by the second light source,wherein the first control unit controls an emission timing of the firstlight source according to the detected infrared light emitted by thesecond light source, wherein the first communication unit transmits acontrol signal including an imaging timing of the second image sensorand an emission timing of the second light source to the second device,wherein the second communication unit receives the control signal, andwherein the second control unit controls the imaging timing of thesecond image sensor and the emission timing of the second light sourceaccording to the control signal.
 2. The system according to claim 1,wherein the first control unit controls the emission timing of the firstlight source such that the first light source and the second lightsource emit light at different timings.
 3. The system according to claim2, wherein the first control unit controls the emission timing of thefirst light source in a manner that the first light source and thesecond light source emit light in a time-division manner.
 4. The systemaccording to claim 1, wherein the first control unit controls theimaging timing of the first image sensor and the emission timing of thefirst light source according to the detected infrared light.
 5. A systemcomprising: a first device including: a first image sensor; a firstlight source that emits infrared light; and a first control unit thatcontrols an imaging timing of the first image sensor and an emissiontiming of the first light source; and a second device including: asecond image sensor; a second light source that emits infrared light;and a second control unit that controls an imaging timing of the secondimage sensor and an emission timing of the second light source, whereinthe first image sensor detects the infrared light emitted by the secondlight source, and wherein the first control unit controls a lightintensity of the first light source according to the infrared lightemitted by the second light source.
 6. The system according to claim 5,wherein the first control unit controls the light intensity of the firstlight source to make a target region have a brightness according to thedetected infrared light emitted by the second light source.
 7. Thesystem according to claim 5, wherein the second control unit controls alight intensity of the second light source.
 8. A device comprising: animage sensor; a light source that emits infrared light; and a controlunit that controls an imaging timing of the image sensor and an emissiontiming of the light source, wherein the image sensor detects infraredlight, and wherein the control unit controls a light intensity of thelight source according to the detected infrared light.
 9. The deviceaccording to claim 8, wherein the control unit controls the lightintensity of the light source to make a target region have a brightnessaccording to the detected infrared light.
 10. A system comprising: afirst light source that emits infrared light; a second light source thatemits infrared light; a sensor that detects infrared light from thesecond light source; and a control unit that control an emitting timingof the second light source to differ from an emitting timing of thefirst light source according to the detected infrared light.
 11. Thesystem according to claim 10, wherein the control unit controls anemitting timing of the first light source to differ from an emittingtiming of the second light source according to the detected infraredlight.
 12. The system according to claim 10, wherein the sensor is animage sensor, and wherein the control unit controls an imaging timing ofthe image sensor according to the detected infrared light.
 13. A systemcomprising: a first light source that emits infrared light; a secondlight source that emits infrared light; and a control unit that controlsan emitting timing of the second light source to differ from an emittingtiming of the first light source.
 14. The system according to claim 13,wherein the control unit controls an emitting timing of the first lightsource to differ from an emitting timing of the second light source.